2024-04-25T13:09:01.249 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T13:09:01.249 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469 --verbose -- /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/orig.config.yaml 2024-04-25T13:09:01.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:09:01.405 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7673469' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4060 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYqkuomIzCabtpBW7YNjtop9vFL4fsVddjZoSpfNkL3ZwHtIKEhiU624UCRzFt4Qw0yRCP6L82NJ1BhapAf7QA= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJVEriTr7y8K+7Cf0JKJYou4B9IC+pb4i54Q4XH1LvaZ4qD66VgIoB8NuqbM/TdIrpZ0M1XDsPsD7OclhwZ+1E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_12:17:05 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T13:09:01.406 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa; will attempt to use it 2024-04-25T13:09:01.406 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks 2024-04-25T13:09:01.406 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T13:09:01.409 INFO:teuthology.task.internal:Checking packages... 2024-04-25T13:09:01.432 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-25T13:09:01.432 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T13:09:01.432 INFO:teuthology.packaging:ref: None 2024-04-25T13:09:01.433 INFO:teuthology.packaging:tag: None 2024-04-25T13:09:01.433 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-25T13:09:01.433 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:09:01.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-25T13:09:01.615 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.gd69f13d8 2024-04-25T13:09:01.617 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T13:09:01.632 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T13:09:01.632 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T13:09:01.690 INFO:teuthology.task.internal:Saving configuration 2024-04-25T13:09:01.713 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T13:09:01.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:09:01.793 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:04:00.058368', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYqkuomIzCabtpBW7YNjtop9vFL4fsVddjZoSpfNkL3ZwHtIKEhiU624UCRzFt4Qw0yRCP6L82NJ1BhapAf7QA='} 2024-04-25T13:09:01.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:04:00.059682', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJVEriTr7y8K+7Cf0JKJYou4B9IC+pb4i54Q4XH1LvaZ4qD66VgIoB8NuqbM/TdIrpZ0M1XDsPsD7OclhwZ+1E='} 2024-04-25T13:09:01.820 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T13:09:01.840 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T13:09:01.840 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T13:09:01.840 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T13:09:01.926 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3cb2d6e0d0>, signals=[15]) 2024-04-25T13:09:01.927 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T13:09:01.935 INFO:teuthology.task.internal:Opening connections... 2024-04-25T13:09:01.936 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:09:01.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:09:02.019 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:09:02.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:09:02.098 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T13:09:02.106 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-04-25T13:09:02.125 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-04-25T13:09:02.125 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-04-25T13:09:02.183 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-04-25T13:09:02.183 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:09:02.184 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:09:02.185 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-04-25T13:09:02.207 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-04-25T13:09:02.224 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-04-25T13:09:02.224 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-25T13:09:02.280 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-04-25T13:09:02.280 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-04-25T13:09:02.280 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-04-25T13:09:02.280 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:09:02.281 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:09:02.281 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-25T13:09:02.306 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T13:09:02.316 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T13:09:02.478 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T13:09:02.479 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:09:02.481 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:09:02.497 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T13:09:02.514 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T13:09:02.514 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:09:02.538 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:09:02.565 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T13:09:02.623 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T13:09:02.639 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T13:09:02.640 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T13:09:02.640 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:09:02.640 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:09:02.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:02.657 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-25T13:09:02.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:02.658 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-04-25T13:09:02.713 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:09:02.713 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.14.0-437.el9.x86_64 2024-04-25T13:09:02.713 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum install -y kernel 2024-04-25T13:09:02.715 INFO:teuthology.orchestra.run.smithi026.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:09:02.715 INFO:teuthology.task.kernel:Running kernel on smithi026: 5.14.0-437.el9.x86_64 2024-04-25T13:09:02.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2024-04-25T13:09:05.141 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.0 MB 00:00 2024-04-25T13:09:07.409 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T13:09:10.361 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.0 MB 00:06 2024-04-25T13:09:11.934 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.2 MB 00:00 2024-04-25T13:09:12.261 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-25T13:09:13.699 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-25T13:09:16.670 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.2 MB 00:00 2024-04-25T13:09:18.210 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 16 kB 00:00 2024-04-25T13:09:19.939 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T13:09:20.801 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 21 MB 00:06 2024-04-25T13:09:25.153 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-25T13:09:25.841 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-25T13:09:27.134 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:09:27.134 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:09:27.215 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-04-25T13:09:27.216 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-04-25T13:09:27.216 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-04-25T13:09:27.317 DEBUG:teuthology.orchestra.run.smithi026:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:09:27.697 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:09:27.697 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:09:27.788 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-25T13:09:27.789 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-25T13:09:27.789 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-25T13:09:27.836 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:09:25 PM UTC. 2024-04-25T13:09:27.895 DEBUG:teuthology.orchestra.run.smithi169:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:09:27.963 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-04-25T13:09:27.972 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-04-25T13:09:27.972 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:27.972 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalling: 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 255 k 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 0 2024-04-25T13:09:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:Operation aborted. 2024-04-25T13:09:28.025 INFO:teuthology.orchestra.run.smithi026.stdout:Is this ok [y/N]: 2024-04-25T13:09:28.025 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum reinstall -y kernel || true 2024-04-25T13:09:28.395 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:09:25 PM UTC. 2024-04-25T13:09:28.518 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-25T13:09:28.526 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-25T13:09:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:28.526 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-25T13:09:28.526 INFO:teuthology.orchestra.run.smithi169.stdout:Reinstalling: 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 255 k 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 0 2024-04-25T13:09:28.527 INFO:teuthology.orchestra.run.smithi169.stderr:Operation aborted. 2024-04-25T13:09:28.544 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:09:25 PM UTC. 2024-04-25T13:09:28.586 INFO:teuthology.orchestra.run.smithi169.stdout:Is this ok [y/N]: 2024-04-25T13:09:28.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum reinstall -y kernel || true 2024-04-25T13:09:28.664 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalling: 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 255 k 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 0 2024-04-25T13:09:28.665 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-04-25T13:09:28.946 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-04-25T13:09:28.947 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:09:28.947 INFO:teuthology.orchestra.run.smithi026.stdout:Total 905 kB/s | 255 kB 00:00 2024-04-25T13:09:28.966 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-04-25T13:09:29.082 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 01:09:25 PM UTC. 2024-04-25T13:09:29.157 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-04-25T13:09:29.158 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-04-25T13:09:29.163 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-04-25T13:09:29.163 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-04-25T13:09:29.199 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-25T13:09:29.199 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-25T13:09:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:Reinstalling: 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 255 k 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 0 2024-04-25T13:09:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-25T13:09:29.310 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-04-25T13:09:29.397 INFO:teuthology.orchestra.run.smithi026.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:29.398 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:29.593 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-437.el9.x86_64.rpm 2.0 MB/s | 255 kB 00:00 2024-04-25T13:09:29.594 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:09:29.594 INFO:teuthology.orchestra.run.smithi169.stdout:Total 647 kB/s | 255 kB 00:00 2024-04-25T13:09:29.612 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-25T13:09:29.783 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-25T13:09:29.783 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-25T13:09:29.787 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-25T13:09:29.788 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-25T13:09:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-25T13:09:30.028 INFO:teuthology.orchestra.run.smithi169.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:30.028 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:30.030 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:30.030 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:30.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:30.698 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:09:30.698 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalled: 2024-04-25T13:09:30.698 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:30.698 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:09:30.698 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-04-25T13:09:30.750 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:30.750 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:30.867 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:09:30.915 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:30.916 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:09:30.916 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:09:30.916 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T13:09:30.916 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:09:30.943 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2024-04-25T13:09:30.963 DEBUG:teuthology.parallel:result is None 2024-04-25T13:09:31.471 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:31.471 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:09:31.471 INFO:teuthology.orchestra.run.smithi169.stdout:Reinstalled: 2024-04-25T13:09:31.471 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:31.471 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:09:31.472 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-25T13:09:31.639 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:09:31.727 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:31.727 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:09:31.727 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:09:31.727 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T13:09:31.727 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:09:31.759 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-04-25T13:09:31.777 DEBUG:teuthology.parallel:result is None 2024-04-25T13:09:31.777 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T13:09:31.787 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T13:09:31.787 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:09:31.789 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:09:31.832 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T13:09:31.845 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T13:09:31.896 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T13:09:31.897 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:09:31.899 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:09:31.939 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T13:09:31.974 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T13:09:31.974 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:09:31.977 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:09:32.008 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:32.009 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:32.018 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:32.020 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:32.021 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T13:09:32.034 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T13:09:32.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:09:32.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:09:32.089 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T13:09:32.155 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T13:09:32.155 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:09:32.157 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:09:32.172 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:32.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:32.303 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:32.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:32.427 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:09:32.427 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:09:32.493 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:32.535 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:32.582 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:32.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:32.702 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:09:32.702 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:09:32.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-04-25T13:09:32.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-04-25T13:09:32.800 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:09:32.843 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:09:33.191 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T13:09:33.199 INFO:teuthology.task.internal:Starting timer... 2024-04-25T13:09:33.199 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T13:09:33.253 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T13:09:33.289 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T13:09:33.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2024-04-25T13:09:33.343 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2024-04-25T13:09:33.345 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-04-25T13:09:33.424 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-04-25T13:09:33.426 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T13:09:33.426 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2024-04-25T13:09:33.455 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2024-04-25T13:09:33.456 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-04-25T13:09:33.481 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-04-25T13:09:33.482 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-04-25T13:09:33.482 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:09:33.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:33.522 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:09:33.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:33.546 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T13:09:33.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:09:33.591 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:09:33.615 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T13:09:33.628 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T13:09:33.644 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T13:09:33.645 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T13:13:04.560 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-04-25T13:13:04.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-25T13:13:04.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:13:04.640 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-04-25T13:13:04.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-25T13:13:04.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-25T13:13:04.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:13:04.815 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-25T13:13:04.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-25T13:13:04.890 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T13:13:04.901 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T13:13:04.901 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:13:04.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:13:04.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:13:04.905 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:13:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:13:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:13:04.959 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:13:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2024-04-25T13:13:04.972 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:13:04.979 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2024-04-25T13:13:04.993 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:13:04.995 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-04-25T13:13:05.006 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-04-25T13:13:05.006 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:13:05.019 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:13:05.031 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:13:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:13:05.068 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:13:05.068 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-04-25T13:13:05.068 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.068 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.069 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.069 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.091 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:13:05.095 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:13:05.095 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-04-25T13:13:05.095 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.095 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.095 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.095 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:05.095 INFO:teuthology.run_tasks:Running task install... 2024-04-25T13:13:05.110 DEBUG:teuthology.task.install:project ceph 2024-04-25T13:13:05.111 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-25T13:13:05.111 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-25T13:13:05.111 INFO:teuthology.task.install:Using flavor: default 2024-04-25T13:13:05.122 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T13:13:05.122 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T13:13:05.123 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T13:13:05.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:13:05.125 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T13:13:05.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:13:05.348 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T13:13:05.348 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T13:13:05.352 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T13:13:05.352 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T13:13:05.465 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:13:05.466 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:13:05.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:13:05.492 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:13:05.492 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:13:05.537 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:13:05.537 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:13:05.537 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:13:05.558 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:13:05.563 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:13:05.563 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:13:05.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:13:05.633 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:13:05.696 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2024-04-25T13:13:05.698 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2024-04-25T13:13:05.702 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:13:05.765 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-04-25T13:13:05.766 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-04-25T13:13:05.931 INFO:teuthology.orchestra.run.smithi026.stdout:48 files removed 2024-04-25T13:13:05.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:13:05.991 INFO:teuthology.orchestra.run.smithi169.stdout:48 files removed 2024-04-25T13:13:06.018 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:13:06.615 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 250 kB/s | 83 kB 00:00 2024-04-25T13:13:06.723 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 170 kB/s | 83 kB 00:00 2024-04-25T13:13:07.073 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-04-25T13:13:07.123 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-04-25T13:13:07.457 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-04-25T13:13:07.465 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-04-25T13:13:08.202 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T13:13:08.634 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-04-25T13:13:10.719 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-25T13:13:11.219 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-25T13:13:15.603 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-25T13:13:17.109 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-25T13:13:18.530 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T13:13:20.412 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 1.0 MB/s | 6.2 MB 00:06 2024-04-25T13:13:22.128 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-25T13:13:23.827 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T13:13:23.830 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T13:13:26.055 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:26.056 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:13:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:13:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:13:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:13:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:13:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:13:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:13:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:26.152 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T13:13:26.153 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T13:13:26.154 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-04-25T13:13:26.155 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:13:26.156 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:26.157 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:13:26.158 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:13:26.159 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:13:26.160 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:13:26.161 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:13:26.162 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-04-25T13:13:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-04-25T13:13:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:Install 148 Packages 2024-04-25T13:13:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 4 Packages 2024-04-25T13:13:26.164 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:13:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 222 M 2024-04-25T13:13:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-04-25T13:13:28.869 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-04-25T13:13:31.012 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:31.013 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:31.023 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:13:31.024 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:13:31.025 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:13:31.026 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:13:31.027 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:13:31.029 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:13:31.030 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:13:31.091 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T13:13:31.100 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:13:31.101 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T13:13:31.102 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:13:31.103 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:13:31.104 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:13:31.105 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:13:31.106 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:13:31.107 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:13:31.108 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:13:31.109 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:13:31.110 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout:Install 148 Packages 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 4 Packages 2024-04-25T13:13:31.111 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:13:31.112 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 222 M 2024-04-25T13:13:31.112 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-25T13:13:32.520 INFO:teuthology.orchestra.run.smithi169.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-25T13:13:33.086 INFO:teuthology.orchestra.run.smithi026.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 23 kB/s | 6.6 kB 00:00 2024-04-25T13:13:33.312 INFO:teuthology.orchestra.run.smithi169.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.1 MB/s | 890 kB 00:00 2024-04-25T13:13:33.521 INFO:teuthology.orchestra.run.smithi169.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 695 kB/s | 145 kB 00:00 2024-04-25T13:13:33.862 INFO:teuthology.orchestra.run.smithi026.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.1 MB/s | 890 kB 00:00 2024-04-25T13:13:34.004 INFO:teuthology.orchestra.run.smithi026.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 1.0 MB/s | 145 kB 00:00 2024-04-25T13:13:34.588 INFO:teuthology.orchestra.run.smithi169.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 2.2 MB/s | 2.4 MB 00:01 2024-04-25T13:13:34.921 INFO:teuthology.orchestra.run.smithi026.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 2.6 MB/s | 2.4 MB 00:00 2024-04-25T13:13:35.163 INFO:teuthology.orchestra.run.smithi169.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 2.6 MB/s | 1.5 MB 00:00 2024-04-25T13:13:35.321 INFO:teuthology.orchestra.run.smithi026.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 3.7 MB/s | 1.5 MB 00:00 2024-04-25T13:13:36.546 INFO:teuthology.orchestra.run.smithi026.stdout:(6/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 3.8 MB/s | 4.7 MB 00:01 2024-04-25T13:13:36.671 INFO:teuthology.orchestra.run.smithi026.stdout:(7/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 1.4 MB/s | 5.4 MB 00:03 2024-04-25T13:13:37.363 INFO:teuthology.orchestra.run.smithi169.stdout:(6/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 2.1 MB/s | 4.7 MB 00:02 2024-04-25T13:13:38.380 INFO:teuthology.orchestra.run.smithi169.stdout:(7/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 886 kB/s | 5.4 MB 00:06 2024-04-25T13:13:41.804 INFO:teuthology.orchestra.run.smithi026.stdout:(8/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x86 3.2 MB/s | 17 MB 00:05 2024-04-25T13:13:41.888 INFO:teuthology.orchestra.run.smithi026.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 303 kB/s | 25 kB 00:00 2024-04-25T13:13:42.305 INFO:teuthology.orchestra.run.smithi026.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 1.9 MB/s | 11 MB 00:05 2024-04-25T13:13:42.830 INFO:teuthology.orchestra.run.smithi026.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 428 kB/s | 225 kB 00:00 2024-04-25T13:13:42.931 INFO:teuthology.orchestra.run.smithi026.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 270 kB/s | 27 kB 00:00 2024-04-25T13:13:43.014 INFO:teuthology.orchestra.run.smithi026.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 381 kB/s | 32 kB 00:00 2024-04-25T13:13:43.522 INFO:teuthology.orchestra.run.smithi026.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 1.4 MB/s | 747 kB 00:00 2024-04-25T13:13:43.690 INFO:teuthology.orchestra.run.smithi026.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 980 kB/s | 163 kB 00:00 2024-04-25T13:13:44.290 INFO:teuthology.orchestra.run.smithi026.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 211 kB/s | 126 kB 00:00 2024-04-25T13:13:44.429 INFO:teuthology.orchestra.run.smithi169.stdout:(8/152): ceph-common-19.0.0-3156.gd69f13d8.el7. 1.7 MB/s | 21 MB 00:12 2024-04-25T13:13:44.504 INFO:teuthology.orchestra.run.smithi169.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 336 kB/s | 25 kB 00:00 2024-04-25T13:13:45.073 INFO:teuthology.orchestra.run.smithi026.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 639 kB/s | 500 kB 00:00 2024-04-25T13:13:45.196 INFO:teuthology.orchestra.run.smithi169.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 1.6 MB/s | 11 MB 00:06 2024-04-25T13:13:45.388 INFO:teuthology.orchestra.run.smithi169.stdout:(11/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 2.1 MB/s | 17 MB 00:08 2024-04-25T13:13:45.413 INFO:teuthology.orchestra.run.smithi169.stdout:(12/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 1.0 MB/s | 225 kB 00:00 2024-04-25T13:13:45.463 INFO:teuthology.orchestra.run.smithi169.stdout:(13/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 361 kB/s | 27 kB 00:00 2024-04-25T13:13:45.497 INFO:teuthology.orchestra.run.smithi169.stdout:(14/152): libcephfs-devel-19.0.0-3156.gd69f13d8 380 kB/s | 32 kB 00:00 2024-04-25T13:13:45.647 INFO:teuthology.orchestra.run.smithi169.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 1.1 MB/s | 163 kB 00:00 2024-04-25T13:13:45.731 INFO:teuthology.orchestra.run.smithi169.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 1.5 MB/s | 126 kB 00:00 2024-04-25T13:13:45.773 INFO:teuthology.orchestra.run.smithi169.stdout:(17/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 2.4 MB/s | 747 kB 00:00 2024-04-25T13:13:45.973 INFO:teuthology.orchestra.run.smithi169.stdout:(18/152): libradosstriper1-19.0.0-3156.gd69f13d 2.0 MB/s | 500 kB 00:00 2024-04-25T13:13:46.065 INFO:teuthology.orchestra.run.smithi169.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 492 kB/s | 45 kB 00:00 2024-04-25T13:13:46.165 INFO:teuthology.orchestra.run.smithi169.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 1.3 MB/s | 135 kB 00:00 2024-04-25T13:13:46.324 INFO:teuthology.orchestra.run.smithi169.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 1.0 MB/s | 161 kB 00:00 2024-04-25T13:13:46.566 INFO:teuthology.orchestra.run.smithi169.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 1.3 MB/s | 320 kB 00:00 2024-04-25T13:13:46.824 INFO:teuthology.orchestra.run.smithi169.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 1.1 MB/s | 298 kB 00:00 2024-04-25T13:13:46.933 INFO:teuthology.orchestra.run.smithi169.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 918 kB/s | 99 kB 00:00 2024-04-25T13:13:47.042 INFO:teuthology.orchestra.run.smithi169.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 787 kB/s | 85 kB 00:00 2024-04-25T13:13:48.475 INFO:teuthology.orchestra.run.smithi169.stdout:(26/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 2.0 MB/s | 5.4 MB 00:02 2024-04-25T13:13:48.659 INFO:teuthology.orchestra.run.smithi169.stdout:(27/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 1.9 MB/s | 3.1 MB 00:01 2024-04-25T13:13:48.684 INFO:teuthology.orchestra.run.smithi169.stdout:(28/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 818 kB/s | 170 kB 00:00 2024-04-25T13:13:48.753 INFO:teuthology.orchestra.run.smithi169.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3156.g 365 kB/s | 34 kB 00:00 2024-04-25T13:13:48.853 INFO:teuthology.orchestra.run.smithi169.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 841 kB/s | 142 kB 00:00 2024-04-25T13:13:50.248 INFO:teuthology.orchestra.run.smithi026.stdout:(18/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 1.0 MB/s | 5.4 MB 00:05 2024-04-25T13:13:50.357 INFO:teuthology.orchestra.run.smithi026.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 417 kB/s | 45 kB 00:00 2024-04-25T13:13:50.557 INFO:teuthology.orchestra.run.smithi026.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 674 kB/s | 135 kB 00:00 2024-04-25T13:13:50.740 INFO:teuthology.orchestra.run.smithi026.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 881 kB/s | 161 kB 00:00 2024-04-25T13:13:51.037 INFO:teuthology.orchestra.run.smithi169.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 1.5 MB/s | 3.5 MB 00:02 2024-04-25T13:13:51.057 INFO:teuthology.orchestra.run.smithi026.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 1.0 MB/s | 320 kB 00:00 2024-04-25T13:13:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 1.0 MB/s | 249 kB 00:00 2024-04-25T13:13:51.341 INFO:teuthology.orchestra.run.smithi026.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 1.0 MB/s | 298 kB 00:00 2024-04-25T13:13:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 493 kB/s | 49 kB 00:00 2024-04-25T13:13:51.441 INFO:teuthology.orchestra.run.smithi026.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 994 kB/s | 99 kB 00:00 2024-04-25T13:13:51.480 INFO:teuthology.orchestra.run.smithi169.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 164 kB/s | 16 kB 00:00 2024-04-25T13:13:51.541 INFO:teuthology.orchestra.run.smithi026.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 853 kB/s | 85 kB 00:00 2024-04-25T13:13:51.905 INFO:teuthology.orchestra.run.smithi169.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 643 kB/s | 273 kB 00:00 2024-04-25T13:13:52.755 INFO:teuthology.orchestra.run.smithi169.stdout:(36/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 897 kB/s | 762 kB 00:00 2024-04-25T13:13:52.855 INFO:teuthology.orchestra.run.smithi169.stdout:(37/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 183 kB/s | 18 kB 00:00 2024-04-25T13:13:52.964 INFO:teuthology.orchestra.run.smithi169.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 743 kB/s | 80 kB 00:00 2024-04-25T13:13:53.048 INFO:teuthology.orchestra.run.smithi169.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2024-04-25T13:13:53.098 INFO:teuthology.orchestra.run.smithi169.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-25T13:13:53.140 INFO:teuthology.orchestra.run.smithi169.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-25T13:13:53.223 INFO:teuthology.orchestra.run.smithi169.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-25T13:13:53.265 INFO:teuthology.orchestra.run.smithi169.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-25T13:13:53.307 INFO:teuthology.orchestra.run.smithi169.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-25T13:13:53.349 INFO:teuthology.orchestra.run.smithi169.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-04-25T13:13:53.383 INFO:teuthology.orchestra.run.smithi169.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 6.4 MB/s | 215 kB 00:00 2024-04-25T13:13:53.442 INFO:teuthology.orchestra.run.smithi169.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-25T13:13:53.517 INFO:teuthology.orchestra.run.smithi169.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-04-25T13:13:53.567 INFO:teuthology.orchestra.run.smithi169.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-25T13:13:53.600 INFO:teuthology.orchestra.run.smithi169.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 647 kB/s | 21 kB 00:00 2024-04-25T13:13:53.667 INFO:teuthology.orchestra.run.smithi169.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-25T13:13:53.718 INFO:teuthology.orchestra.run.smithi169.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-04-25T13:13:53.868 INFO:teuthology.orchestra.run.smithi169.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-04-25T13:13:53.902 INFO:teuthology.orchestra.run.smithi169.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 549 kB/s | 18 kB 00:00 2024-04-25T13:13:53.935 INFO:teuthology.orchestra.run.smithi169.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-04-25T13:13:53.986 INFO:teuthology.orchestra.run.smithi169.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T13:13:53.991 INFO:teuthology.orchestra.run.smithi026.stdout:(26/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 4.1 MB/s | 49 MB 00:12 2024-04-25T13:13:54.019 INFO:teuthology.orchestra.run.smithi169.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T13:13:54.070 INFO:teuthology.orchestra.run.smithi169.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-25T13:13:54.112 INFO:teuthology.orchestra.run.smithi169.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 582 kB 00:00 2024-04-25T13:13:54.145 INFO:teuthology.orchestra.run.smithi169.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 767 kB/s | 25 kB 00:00 2024-04-25T13:13:54.167 INFO:teuthology.orchestra.run.smithi026.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 976 kB/s | 170 kB 00:00 2024-04-25T13:13:54.179 INFO:teuthology.orchestra.run.smithi169.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T13:13:54.221 INFO:teuthology.orchestra.run.smithi169.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-25T13:13:54.263 INFO:teuthology.orchestra.run.smithi169.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-25T13:13:54.267 INFO:teuthology.orchestra.run.smithi026.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 341 kB/s | 34 kB 00:00 2024-04-25T13:13:54.297 INFO:teuthology.orchestra.run.smithi169.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-04-25T13:13:54.367 INFO:teuthology.orchestra.run.smithi026.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 1.4 MB/s | 142 kB 00:00 2024-04-25T13:13:54.431 INFO:teuthology.orchestra.run.smithi169.stdout:(65/152): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-04-25T13:13:54.556 INFO:teuthology.orchestra.run.smithi169.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-04-25T13:13:54.648 INFO:teuthology.orchestra.run.smithi169.stdout:(67/152): ceph-mgr-diskprediction-local-19.0.0- 1.3 MB/s | 7.4 MB 00:05 2024-04-25T13:13:54.689 INFO:teuthology.orchestra.run.smithi169.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T13:13:54.731 INFO:teuthology.orchestra.run.smithi169.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-04-25T13:13:54.756 INFO:teuthology.orchestra.run.smithi169.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T13:13:54.824 INFO:teuthology.orchestra.run.smithi169.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-04-25T13:13:54.907 INFO:teuthology.orchestra.run.smithi169.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-04-25T13:13:54.932 INFO:teuthology.orchestra.run.smithi169.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 820 kB/s | 87 kB 00:00 2024-04-25T13:13:55.074 INFO:teuthology.orchestra.run.smithi169.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-04-25T13:13:55.100 INFO:teuthology.orchestra.run.smithi169.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-04-25T13:13:55.125 INFO:teuthology.orchestra.run.smithi169.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T13:13:55.126 INFO:teuthology.orchestra.run.smithi026.stdout:(30/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 882 kB/s | 3.1 MB 00:03 2024-04-25T13:13:55.150 INFO:teuthology.orchestra.run.smithi169.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-04-25T13:13:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-25T13:13:55.201 INFO:teuthology.orchestra.run.smithi169.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T13:13:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-04-25T13:13:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-04-25T13:13:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-04-25T13:13:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-25T13:13:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T13:13:55.453 INFO:teuthology.orchestra.run.smithi169.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-04-25T13:13:55.478 INFO:teuthology.orchestra.run.smithi169.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-25T13:13:55.504 INFO:teuthology.orchestra.run.smithi169.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T13:13:55.529 INFO:teuthology.orchestra.run.smithi169.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T13:13:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T13:13:55.568 INFO:teuthology.orchestra.run.smithi026.stdout:(31/152): ceph-common-19.0.0-3156.gd69f13d8.el7 950 kB/s | 21 MB 00:22 2024-04-25T13:13:55.579 INFO:teuthology.orchestra.run.smithi169.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T13:13:55.646 INFO:teuthology.orchestra.run.smithi169.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 641 kB/s | 42 kB 00:00 2024-04-25T13:13:55.755 INFO:teuthology.orchestra.run.smithi169.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 414 kB/s | 44 kB 00:00 2024-04-25T13:13:55.976 INFO:teuthology.orchestra.run.smithi026.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 610 kB/s | 249 kB 00:00 2024-04-25T13:13:56.006 INFO:teuthology.orchestra.run.smithi169.stdout:(93/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-04-25T13:13:56.030 INFO:teuthology.orchestra.run.smithi169.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 808 kB/s | 221 kB 00:00 2024-04-25T13:13:56.056 INFO:teuthology.orchestra.run.smithi169.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 722 kB/s | 36 kB 00:00 2024-04-25T13:13:56.081 INFO:teuthology.orchestra.run.smithi169.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-25T13:13:56.106 INFO:teuthology.orchestra.run.smithi169.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-25T13:13:56.118 INFO:teuthology.orchestra.run.smithi026.stdout:(33/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 2.0 MB/s | 3.5 MB 00:01 2024-04-25T13:13:56.131 INFO:teuthology.orchestra.run.smithi169.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T13:13:56.157 INFO:teuthology.orchestra.run.smithi169.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T13:13:56.182 INFO:teuthology.orchestra.run.smithi169.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T13:13:56.207 INFO:teuthology.orchestra.run.smithi169.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-04-25T13:13:56.218 INFO:teuthology.orchestra.run.smithi026.stdout:(34/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 204 kB/s | 49 kB 00:00 2024-04-25T13:13:56.233 INFO:teuthology.orchestra.run.smithi169.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-04-25T13:13:56.244 INFO:teuthology.orchestra.run.smithi026.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3156.gd 131 kB/s | 16 kB 00:00 2024-04-25T13:13:56.283 INFO:teuthology.orchestra.run.smithi169.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-04-25T13:13:56.542 INFO:teuthology.orchestra.run.smithi169.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-04-25T13:13:56.567 INFO:teuthology.orchestra.run.smithi169.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-04-25T13:13:56.608 INFO:teuthology.orchestra.run.smithi169.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-04-25T13:13:56.677 INFO:teuthology.orchestra.run.smithi026.stdout:(36/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 596 kB/s | 273 kB 00:00 2024-04-25T13:13:56.759 INFO:teuthology.orchestra.run.smithi169.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 173 kB/s | 26 kB 00:00 2024-04-25T13:13:56.786 INFO:teuthology.orchestra.run.smithi026.stdout:(37/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 1.4 MB/s | 762 kB 00:00 2024-04-25T13:13:56.811 INFO:teuthology.orchestra.run.smithi026.stdout:(38/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 136 kB/s | 18 kB 00:00 2024-04-25T13:13:56.918 INFO:teuthology.orchestra.run.smithi169.stdout:(108/152): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-25T13:13:56.943 INFO:teuthology.orchestra.run.smithi169.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 267 kB/s | 49 kB 00:00 2024-04-25T13:13:56.944 INFO:teuthology.orchestra.run.smithi026.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-04-25T13:13:56.993 INFO:teuthology.orchestra.run.smithi169.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 897 kB/s | 67 kB 00:00 2024-04-25T13:13:56.995 INFO:teuthology.orchestra.run.smithi026.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2024-04-25T13:13:57.018 INFO:teuthology.orchestra.run.smithi169.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-25T13:13:57.020 INFO:teuthology.orchestra.run.smithi026.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-04-25T13:13:57.045 INFO:teuthology.orchestra.run.smithi026.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-04-25T13:13:57.094 INFO:teuthology.orchestra.run.smithi169.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.2 MB/s | 838 kB 00:00 2024-04-25T13:13:57.104 INFO:teuthology.orchestra.run.smithi026.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-25T13:13:57.129 INFO:teuthology.orchestra.run.smithi026.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-04-25T13:13:57.144 INFO:teuthology.orchestra.run.smithi169.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-25T13:13:57.154 INFO:teuthology.orchestra.run.smithi026.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T13:13:57.178 INFO:teuthology.orchestra.run.smithi169.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 519 kB/s | 43 kB 00:00 2024-04-25T13:13:57.180 INFO:teuthology.orchestra.run.smithi026.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T13:13:57.205 INFO:teuthology.orchestra.run.smithi026.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T13:13:57.230 INFO:teuthology.orchestra.run.smithi026.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-25T13:13:57.253 INFO:teuthology.orchestra.run.smithi169.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-04-25T13:13:57.264 INFO:teuthology.orchestra.run.smithi026.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-25T13:13:57.278 INFO:teuthology.orchestra.run.smithi169.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-25T13:13:57.289 INFO:teuthology.orchestra.run.smithi026.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T13:13:57.315 INFO:teuthology.orchestra.run.smithi026.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 429 kB/s | 21 kB 00:00 2024-04-25T13:13:57.337 INFO:teuthology.orchestra.run.smithi169.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-25T13:13:57.340 INFO:teuthology.orchestra.run.smithi026.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-25T13:13:57.365 INFO:teuthology.orchestra.run.smithi026.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 663 kB/s | 33 kB 00:00 2024-04-25T13:13:57.370 INFO:teuthology.orchestra.run.smithi169.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-25T13:13:57.396 INFO:teuthology.orchestra.run.smithi169.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-04-25T13:13:57.438 INFO:teuthology.orchestra.run.smithi169.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 532 kB/s | 35 kB 00:00 2024-04-25T13:13:57.463 INFO:teuthology.orchestra.run.smithi169.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-04-25T13:13:57.574 INFO:teuthology.orchestra.run.smithi026.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-25T13:13:57.599 INFO:teuthology.orchestra.run.smithi026.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 78 kB/s | 18 kB 00:00 2024-04-25T13:13:57.621 INFO:teuthology.orchestra.run.smithi169.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-25T13:13:57.624 INFO:teuthology.orchestra.run.smithi026.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-25T13:13:57.649 INFO:teuthology.orchestra.run.smithi026.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T13:13:57.692 INFO:teuthology.orchestra.run.smithi026.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-04-25T13:13:57.717 INFO:teuthology.orchestra.run.smithi026.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 9.6 MB/s | 662 kB 00:00 2024-04-25T13:13:57.722 INFO:teuthology.orchestra.run.smithi169.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 559 kB/s | 144 kB 00:00 2024-04-25T13:13:57.747 INFO:teuthology.orchestra.run.smithi169.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-25T13:13:57.767 INFO:teuthology.orchestra.run.smithi026.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 582 kB 00:00 2024-04-25T13:13:57.789 INFO:teuthology.orchestra.run.smithi169.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-04-25T13:13:57.792 INFO:teuthology.orchestra.run.smithi026.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-25T13:13:57.826 INFO:teuthology.orchestra.run.smithi026.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-25T13:13:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-25T13:13:57.864 INFO:teuthology.orchestra.run.smithi169.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-04-25T13:13:57.881 INFO:teuthology.orchestra.run.smithi169.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-04-25T13:13:57.893 INFO:teuthology.orchestra.run.smithi026.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-25T13:13:57.918 INFO:teuthology.orchestra.run.smithi026.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 603 kB/s | 35 kB 00:00 2024-04-25T13:13:57.923 INFO:teuthology.orchestra.run.smithi169.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-04-25T13:13:58.048 INFO:teuthology.orchestra.run.smithi169.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-04-25T13:13:58.065 INFO:teuthology.orchestra.run.smithi169.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 326 kB/s | 46 kB 00:00 2024-04-25T13:13:58.102 INFO:teuthology.orchestra.run.smithi026.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-04-25T13:13:58.115 INFO:teuthology.orchestra.run.smithi169.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-25T13:13:58.141 INFO:teuthology.orchestra.run.smithi169.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-04-25T13:13:58.169 INFO:teuthology.orchestra.run.smithi026.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-25T13:13:58.208 INFO:teuthology.orchestra.run.smithi169.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-25T13:13:58.219 INFO:teuthology.orchestra.run.smithi026.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-25T13:13:58.233 INFO:teuthology.orchestra.run.smithi169.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-04-25T13:13:58.258 INFO:teuthology.orchestra.run.smithi169.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-25T13:13:58.270 INFO:teuthology.orchestra.run.smithi026.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 9.1 MB/s | 911 kB 00:00 2024-04-25T13:13:58.295 INFO:teuthology.orchestra.run.smithi026.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-25T13:13:58.309 INFO:teuthology.orchestra.run.smithi169.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-04-25T13:13:58.337 INFO:teuthology.orchestra.run.smithi169.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-25T13:13:58.401 INFO:teuthology.orchestra.run.smithi169.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-25T13:13:58.427 INFO:teuthology.orchestra.run.smithi169.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 644 kB/s | 59 kB 00:00 2024-04-25T13:13:58.454 INFO:teuthology.orchestra.run.smithi026.stdout:(71/152): postgresql-server-13.14-1.el9.x86_64. 32 MB/s | 5.8 MB 00:00 2024-04-25T13:13:58.478 INFO:teuthology.orchestra.run.smithi169.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 477 kB/s | 36 kB 00:00 2024-04-25T13:13:58.498 INFO:teuthology.orchestra.run.smithi026.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2024-04-25T13:13:58.503 INFO:teuthology.orchestra.run.smithi169.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-04-25T13:13:58.525 INFO:teuthology.orchestra.run.smithi026.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-25T13:13:58.574 INFO:teuthology.orchestra.run.smithi169.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-25T13:13:58.600 INFO:teuthology.orchestra.run.smithi169.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 976 kB/s | 90 kB 00:00 2024-04-25T13:13:58.625 INFO:teuthology.orchestra.run.smithi169.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-04-25T13:13:58.645 INFO:teuthology.orchestra.run.smithi169.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 402 kB/s | 20 kB 00:00 2024-04-25T13:13:58.707 INFO:teuthology.orchestra.run.smithi026.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-04-25T13:13:58.730 INFO:teuthology.orchestra.run.smithi026.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-25T13:13:58.758 INFO:teuthology.orchestra.run.smithi026.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T13:13:58.779 INFO:teuthology.orchestra.run.smithi169.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-25T13:13:58.780 INFO:teuthology.orchestra.run.smithi026.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 516 kB/s | 26 kB 00:00 2024-04-25T13:13:58.798 INFO:teuthology.orchestra.run.smithi026.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 458 kB/s | 19 kB 00:00 2024-04-25T13:13:58.823 INFO:teuthology.orchestra.run.smithi026.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-04-25T13:13:58.838 INFO:teuthology.orchestra.run.smithi169.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-04-25T13:13:58.848 INFO:teuthology.orchestra.run.smithi026.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-04-25T13:13:59.015 INFO:teuthology.orchestra.run.smithi026.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-04-25T13:13:59.040 INFO:teuthology.orchestra.run.smithi026.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-04-25T13:13:59.065 INFO:teuthology.orchestra.run.smithi026.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-25T13:13:59.090 INFO:teuthology.orchestra.run.smithi026.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T13:13:59.116 INFO:teuthology.orchestra.run.smithi026.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-04-25T13:13:59.141 INFO:teuthology.orchestra.run.smithi026.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-25T13:13:59.166 INFO:teuthology.orchestra.run.smithi026.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T13:13:59.200 INFO:teuthology.orchestra.run.smithi026.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-04-25T13:13:59.226 INFO:teuthology.orchestra.run.smithi026.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-04-25T13:13:59.276 INFO:teuthology.orchestra.run.smithi026.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 715 kB/s | 54 kB 00:00 2024-04-25T13:13:59.510 INFO:teuthology.orchestra.run.smithi026.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 180 kB/s | 42 kB 00:00 2024-04-25T13:13:59.851 INFO:teuthology.orchestra.run.smithi026.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-04-25T13:13:59.876 INFO:teuthology.orchestra.run.smithi026.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 121 kB/s | 44 kB 00:00 2024-04-25T13:13:59.902 INFO:teuthology.orchestra.run.smithi026.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-25T13:13:59.927 INFO:teuthology.orchestra.run.smithi026.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-04-25T13:13:59.961 INFO:teuthology.orchestra.run.smithi026.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-04-25T13:13:59.986 INFO:teuthology.orchestra.run.smithi026.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T13:14:00.011 INFO:teuthology.orchestra.run.smithi026.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T13:14:00.037 INFO:teuthology.orchestra.run.smithi026.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T13:14:00.062 INFO:teuthology.orchestra.run.smithi026.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T13:14:00.087 INFO:teuthology.orchestra.run.smithi026.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-04-25T13:14:00.112 INFO:teuthology.orchestra.run.smithi026.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-04-25T13:14:00.154 INFO:teuthology.orchestra.run.smithi026.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-04-25T13:14:00.671 INFO:teuthology.orchestra.run.smithi026.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 598 kB/s | 309 kB 00:00 2024-04-25T13:14:00.705 INFO:teuthology.orchestra.run.smithi026.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 927 kB/s | 548 kB 00:00 2024-04-25T13:14:00.763 INFO:teuthology.orchestra.run.smithi026.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-04-25T13:14:00.864 INFO:teuthology.orchestra.run.smithi026.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-04-25T13:14:00.964 INFO:teuthology.orchestra.run.smithi026.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-04-25T13:14:01.054 INFO:teuthology.orchestra.run.smithi169.stdout:(148/152): librados2-19.0.0-3156.gd69f13d8.el7. 1.5 MB/s | 3.4 MB 00:02 2024-04-25T13:14:01.114 INFO:teuthology.orchestra.run.smithi026.stdout:(109/152): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-25T13:14:01.128 INFO:teuthology.orchestra.run.smithi169.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-04-25T13:14:01.140 INFO:teuthology.orchestra.run.smithi026.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 384 kB/s | 67 kB 00:00 2024-04-25T13:14:01.223 INFO:teuthology.orchestra.run.smithi026.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-04-25T13:14:01.254 INFO:teuthology.orchestra.run.smithi169.stdout:(150/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 1.3 MB/s | 3.1 MB 00:02 2024-04-25T13:14:01.296 INFO:teuthology.orchestra.run.smithi169.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-04-25T13:14:01.348 INFO:teuthology.orchestra.run.smithi026.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-25T13:14:01.407 INFO:teuthology.orchestra.run.smithi026.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2024-04-25T13:14:01.466 INFO:teuthology.orchestra.run.smithi026.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-04-25T13:14:01.524 INFO:teuthology.orchestra.run.smithi026.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 275 kB/s | 32 kB 00:00 2024-04-25T13:14:01.591 INFO:teuthology.orchestra.run.smithi026.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2024-04-25T13:14:01.652 INFO:teuthology.orchestra.run.smithi026.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-04-25T13:14:01.719 INFO:teuthology.orchestra.run.smithi026.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-25T13:14:01.786 INFO:teuthology.orchestra.run.smithi026.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-04-25T13:14:01.828 INFO:teuthology.orchestra.run.smithi026.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-04-25T13:14:01.911 INFO:teuthology.orchestra.run.smithi026.stdout:(121/152): ceph-mgr-diskprediction-local-19.0.0 1.1 MB/s | 7.4 MB 00:06 2024-04-25T13:14:01.986 INFO:teuthology.orchestra.run.smithi026.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-04-25T13:14:02.012 INFO:teuthology.orchestra.run.smithi026.stdout:(123/152): python3-google-auth-2.29.0-1.el9.noa 911 kB/s | 206 kB 00:00 2024-04-25T13:14:02.087 INFO:teuthology.orchestra.run.smithi026.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-04-25T13:14:02.112 INFO:teuthology.orchestra.run.smithi026.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-04-25T13:14:02.187 INFO:teuthology.orchestra.run.smithi026.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-04-25T13:14:02.213 INFO:teuthology.orchestra.run.smithi026.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-25T13:14:02.280 INFO:teuthology.orchestra.run.smithi026.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-04-25T13:14:02.372 INFO:teuthology.orchestra.run.smithi026.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 506 kB/s | 46 kB 00:00 2024-04-25T13:14:02.397 INFO:teuthology.orchestra.run.smithi026.stdout:(130/152): python3-grpcio-tools-1.46.7-10.el9.x 298 kB/s | 144 kB 00:00 2024-04-25T13:14:02.431 INFO:teuthology.orchestra.run.smithi026.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-04-25T13:14:02.464 INFO:teuthology.orchestra.run.smithi026.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-04-25T13:14:02.514 INFO:teuthology.orchestra.run.smithi026.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 493 kB/s | 58 kB 00:00 2024-04-25T13:14:02.540 INFO:teuthology.orchestra.run.smithi026.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-04-25T13:14:02.573 INFO:teuthology.orchestra.run.smithi026.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-04-25T13:14:02.640 INFO:teuthology.orchestra.run.smithi026.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-04-25T13:14:02.657 INFO:teuthology.orchestra.run.smithi026.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 631 kB/s | 90 kB 00:00 2024-04-25T13:14:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-04-25T13:14:02.749 INFO:teuthology.orchestra.run.smithi026.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-25T13:14:02.783 INFO:teuthology.orchestra.run.smithi026.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 472 kB/s | 59 kB 00:00 2024-04-25T13:14:02.808 INFO:teuthology.orchestra.run.smithi026.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 285 kB/s | 36 kB 00:00 2024-04-25T13:14:02.842 INFO:teuthology.orchestra.run.smithi026.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 553 kB/s | 51 kB 00:00 2024-04-25T13:14:02.917 INFO:teuthology.orchestra.run.smithi026.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 826 kB/s | 90 kB 00:00 2024-04-25T13:14:02.967 INFO:teuthology.orchestra.run.smithi026.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-25T13:14:02.993 INFO:teuthology.orchestra.run.smithi026.stdout:(145/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-04-25T13:14:03.034 INFO:teuthology.orchestra.run.smithi026.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-04-25T13:14:03.093 INFO:teuthology.orchestra.run.smithi026.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-04-25T13:14:03.402 INFO:teuthology.orchestra.run.smithi026.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-04-25T13:14:03.477 INFO:teuthology.orchestra.run.smithi026.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-04-25T13:14:03.594 INFO:teuthology.orchestra.run.smithi026.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-25T13:14:04.836 INFO:teuthology.orchestra.run.smithi026.stdout:(151/152): librados2-19.0.0-3156.gd69f13d8.el7. 1.9 MB/s | 3.4 MB 00:01 2024-04-25T13:14:05.119 INFO:teuthology.orchestra.run.smithi026.stdout:(152/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 1.6 MB/s | 3.1 MB 00:02 2024-04-25T13:14:05.123 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:14:05.124 INFO:teuthology.orchestra.run.smithi026.stdout:Total 5.7 MB/s | 222 MB 00:38 2024-04-25T13:14:05.304 INFO:teuthology.orchestra.run.smithi169.stdout:(152/152): ceph-test-19.0.0-3156.gd69f13d8.el7. 2.4 MB/s | 49 MB 00:20 2024-04-25T13:14:05.309 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:14:05.309 INFO:teuthology.orchestra.run.smithi169.stdout:Total 6.5 MB/s | 222 MB 00:34 2024-04-25T13:14:06.250 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-04-25T13:14:06.349 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-25T13:14:06.409 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-04-25T13:14:06.409 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-04-25T13:14:06.489 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-25T13:14:06.490 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-25T13:14:08.284 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-04-25T13:14:08.284 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-04-25T13:14:08.306 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-25T13:14:08.306 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-25T13:14:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-25T13:14:14.325 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-04-25T13:14:14.349 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:14:14.387 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:14:14.415 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:14:14.441 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:14:14.454 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:14:14.475 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:14:14.501 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:14:14.508 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:14:14.543 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:14:14.549 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:14:14.574 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:14:14.618 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:14:14.882 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:14:14.963 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:14:14.993 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:15.075 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:15.115 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:15.144 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:15.208 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:15.234 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:15.235 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:15.265 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:14:15.327 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:15.364 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:14:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:14:15.470 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:14:15.499 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:15.542 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:14:15.594 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:14:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:15.622 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:15.704 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:15.726 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:15.726 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:15.750 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:15.756 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:15.810 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:15.833 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:15.855 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:15.909 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:15.942 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:16.050 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:14:16.059 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:16.091 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:14:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:14:16.297 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:14:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:14:16.330 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:14:16.350 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:14:16.366 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:14:16.393 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:14:16.426 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:14:16.450 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:14:16.454 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:14:16.498 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:14:16.523 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:14:16.542 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:14:16.574 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:14:16.576 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:14:16.602 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:14:16.607 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:14:16.654 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:14:16.673 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:14:16.725 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:14:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:14:16.754 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:14:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T13:14:16.798 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:14:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T13:14:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T13:14:16.878 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:14:16.909 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T13:14:16.911 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:14:16.953 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T13:14:16.957 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:14:16.981 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T13:14:17.031 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:14:17.054 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:14:17.096 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:14:17.163 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:14:17.175 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:14:17.218 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:14:17.320 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:14:17.382 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:14:17.740 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:14:17.822 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:14:17.859 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:14:17.902 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:14:17.940 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T13:14:17.946 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:14:17.990 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:14:18.030 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:14:18.064 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:14:18.098 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:14:18.137 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T13:14:18.150 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:14:18.179 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:14:18.209 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:14:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:14:18.338 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:14:18.341 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:14:18.368 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:14:18.397 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:14:18.397 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:14:18.443 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:14:18.454 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:14:18.479 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:14:18.523 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:14:18.528 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:14:18.564 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:14:18.565 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:14:18.601 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:14:18.649 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:14:18.684 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:14:18.702 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:14:18.728 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:14:18.754 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:14:18.770 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:14:18.784 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:14:18.825 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:14:18.913 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:14:18.919 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:14:18.958 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:14:18.967 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:14:18.988 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:14:19.007 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:14:19.030 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:14:19.033 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:14:19.058 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:14:19.130 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:14:19.132 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:14:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:14:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:14:19.236 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:14:19.261 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:14:19.261 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:14:19.290 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:14:19.318 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:14:19.348 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:14:19.352 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:14:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:14:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:14:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:14:19.478 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:14:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:14:19.510 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:14:19.521 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:14:19.538 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:14:19.562 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:14:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:14:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:14:19.611 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:14:19.643 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:14:19.672 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:14:19.683 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:14:19.707 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:14:19.728 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:14:19.741 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:14:19.767 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:14:19.782 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:14:19.814 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:14:19.816 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:14:19.907 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:14:19.913 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:14:19.964 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:14:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:14:19.995 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:14:20.042 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:14:20.155 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:14:20.205 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:14:20.692 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:14:20.741 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:14:20.775 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:14:20.873 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:14:20.924 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:14:20.982 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:14:21.011 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:14:21.026 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:14:21.043 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:14:21.060 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:14:21.163 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:14:21.219 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:14:21.221 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:14:21.249 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:14:21.309 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:14:21.318 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:14:21.353 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:14:21.541 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:14:21.584 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:14:21.665 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:14:21.965 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:14:22.072 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:14:22.354 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:14:22.478 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:14:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:14:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:14:23.406 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:14:23.439 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:14:23.751 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:14:23.791 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:14:23.803 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:23.871 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:14:23.885 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:23.899 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:14:23.915 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T13:14:23.932 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:14:23.951 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:14:24.260 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:14:24.303 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:24.395 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:24.424 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T13:14:24.433 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:14:24.461 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:14:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T13:14:24.966 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:14:24.989 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:25.061 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:25.090 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T13:14:26.852 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:26.895 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:27.434 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:27.490 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:27.529 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:27.573 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:14:27.573 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:14:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:27.608 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:28.098 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:28.140 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:28.233 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:28.233 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:14:28.234 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:14:28.234 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:28.258 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-04-25T13:14:39.225 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-04-25T13:14:39.226 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:39.396 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:39.410 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:39.410 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:39.411 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:14:39.411 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /root 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2024-04-25T13:14:40.126 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:40.302 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:40.318 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:40.318 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:40.318 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:14:40.318 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:40.854 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:40.880 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:40.880 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:40.880 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:14:40.880 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:40.880 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:40.880 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:41.127 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:41.127 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:14:41.128 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:41.128 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:41.564 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:41.586 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:41.586 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:41.587 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:14:41.587 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:41.587 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:41.587 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:41.694 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:14:41.751 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:14:41.806 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:14:41.854 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:41.880 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:41.880 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:41.880 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:14:41.880 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:41.881 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:41.881 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:14:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:14:42.114 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:14:42.137 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:42.137 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:42.137 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:14:42.137 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:42.137 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:42.138 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:42.223 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:14:42.362 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:14:42.415 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:14:42.447 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:14:42.474 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:14:42.607 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:42.631 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:42.632 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:42.632 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:14:42.632 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:42.632 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:42.632 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:42.738 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:14:42.796 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:14:42.862 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:14:42.868 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:42.898 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:42.930 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T13:14:42.992 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T13:14:43.030 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:43.066 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:14:43.117 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:14:43.198 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:14:43.295 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:14:43.438 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:14:43.478 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:14:43.507 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:14:43.534 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:14:43.981 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:44.008 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:44.040 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T13:14:44.063 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:44.104 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T13:14:44.115 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:44.139 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:45.216 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:45.328 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:45.329 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:45.391 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T13:14:45.418 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:45.440 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:45.440 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:45.440 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:14:45.441 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:45.441 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:45.441 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:45.594 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T13:14:45.653 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T13:14:46.304 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:46.341 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:46.450 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:46.572 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:14:46.612 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T13:14:46.634 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:46.634 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.634 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:14:46.635 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:46.635 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:46.635 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:46.652 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:46.676 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:46.676 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.676 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:14:46.676 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:46.676 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:46.676 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:46.680 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:46.701 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:46.701 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.701 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:14:46.701 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:46.727 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:46.738 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:46.750 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:46.769 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:46.769 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.769 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:14:46.769 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:46.769 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:46.770 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:46.840 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T13:14:46.894 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T13:14:47.072 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:47.095 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:47.095 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:47.095 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:14:47.095 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:47.095 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:47.095 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:14:47.870 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:14:47.896 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:47.921 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:47.921 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:47.921 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:14:47.921 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:47.921 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:47.921 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:47.964 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:47.987 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:47.987 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:47.987 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:14:47.987 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:48.039 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:48.063 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:48.063 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:48.063 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:14:48.063 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:48.063 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:48.063 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:48.381 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:48.405 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:48.405 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:48.405 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:14:48.405 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:48.405 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:48.405 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:14:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T13:14:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T13:14:51.775 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T13:14:51.807 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:14:51.834 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:14:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T13:14:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:14:52.077 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T13:14:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:53.269 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T13:14:53.311 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T13:14:53.352 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T13:14:53.382 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:14:53.410 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:14:53.589 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T13:14:53.607 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T13:14:53.648 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:14:53.677 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T13:14:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:14:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:14:53.818 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:14:53.859 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:14:53.859 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:53.943 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:53.976 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:14:53.976 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:54.055 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:54.124 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:14:54.311 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:54.350 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:54.370 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:55.279 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T13:14:55.362 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:14:55.397 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:14:55.498 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:14:55.533 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:14:55.534 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:55.618 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:55.650 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:14:55.651 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:55.747 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:55.821 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T13:15:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T13:15:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T13:15:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:15:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:15:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:15:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:15:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:15:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:15:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:15:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:15:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T13:15:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:15:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:15:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:15:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:15:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T13:15:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T13:15:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T13:15:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T13:15:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T13:15:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T13:15:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T13:15:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T13:15:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T13:15:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T13:15:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T13:15:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T13:15:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T13:15:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:15:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:15:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:15:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:15:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:15:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:15:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:15:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:15:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:15:02.066 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:15:02.067 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.068 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:15:02.069 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:15:02.070 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:15:02.071 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:15:02.072 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:15:02.073 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:15:02.074 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:15:02.075 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:15:02.076 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:15:02.077 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:15:02.078 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:15:02.078 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:02.078 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-25T13:15:02.486 DEBUG:teuthology.parallel:result is None 2024-04-25T13:15:03.867 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:15:03.868 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:15:03.870 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:15:03.871 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:15:03.872 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:15:03.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:15:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:15:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:15:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:15:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:15:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:15:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:15:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:03.879 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-04-25T13:15:04.290 DEBUG:teuthology.parallel:result is None 2024-04-25T13:15:04.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:15:04.433 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:15:04.456 INFO:teuthology.orchestra.run.smithi026.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:04.457 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:04.457 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T13:15:04.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:15:04.678 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:15:04.700 INFO:teuthology.orchestra.run.smithi169.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:04.700 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:04.700 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T13:15:04.701 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T13:15:04.702 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:04.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:15:04.728 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:04.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:15:04.766 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T13:15:04.767 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:04.767 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:15:04.795 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:15:04.860 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:04.860 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:15:04.883 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:15:04.947 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T13:15:04.947 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:04.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:15:04.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:15:05.040 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:05.040 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:15:05.064 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:15:05.128 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T13:15:05.128 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:05.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:15:05.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:15:05.221 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:05.221 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:15:05.245 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:15:05.308 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T13:15:05.396 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T13:15:05.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2024-04-25T13:15:05.398 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-04-25T13:15:05.421 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T13:15:05.421 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:15:05.463 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:15:05.485 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T13:15:05.486 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:15:05.528 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:15:05.557 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T13:15:05.557 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T13:15:05.557 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T13:15:05.557 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:05.557 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:15:05.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:05.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:05.743 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:05.743 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:15:05.758 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:05.864 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:05.911 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T13:15:05.911 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T13:15:05.912 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7673469', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '4d7908725372ec8e17504b848bfa122dd1d43386'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4060, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': '4d7908725372ec8e17504b848bfa122dd1d43386', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYqkuomIzCabtpBW7YNjtop9vFL4fsVddjZoSpfNkL3ZwHtIKEhiU624UCRzFt4Qw0yRCP6L82NJ1BhapAf7QA=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJVEriTr7y8K+7Cf0JKJYou4B9IC+pb4i54Q4XH1LvaZ4qD66VgIoB8NuqbM/TdIrpZ0M1XDsPsD7OclhwZ+1E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_12:17:05', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T13:15:05.912 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:15:05.915 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:15:05.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:15:05.970 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:15:06.025 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:06.025 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:15:06.049 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:15:06.049 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-04-25T13:15:06.104 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-25 13:14:56.197247302 +0000 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-25 13:12:46.175981539 +0000 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-25 13:12:46.175981539 +0000 2024-04-25T13:15:06.105 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-04-25 13:12:46.175981539 +0000 2024-04-25T13:15:06.105 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:15:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-25T13:15:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-25T13:15:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.3578e-05 s, 5.5 MB/s 2024-04-25T13:15:06.168 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:15:06.225 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-04-25T13:15:06.280 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-25 13:14:56.198247288 +0000 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-25 13:12:46.532976527 +0000 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-25 13:12:46.532976527 +0000 2024-04-25T13:15:06.281 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-04-25 13:12:46.532976527 +0000 2024-04-25T13:15:06.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:15:06.342 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-25T13:15:06.343 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-25T13:15:06.343 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.986e-05 s, 5.1 MB/s 2024-04-25T13:15:06.344 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:15:06.400 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-04-25T13:15:06.456 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:15:06.456 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:06.456 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T13:15:06.457 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:06.457 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:06.457 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-25 13:14:56.198247288 +0000 2024-04-25T13:15:06.457 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-25 13:12:46.891971486 +0000 2024-04-25T13:15:06.457 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-25 13:12:46.891971486 +0000 2024-04-25T13:15:06.457 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-04-25 13:12:46.891971486 +0000 2024-04-25T13:15:06.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:15:06.519 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-25T13:15:06.519 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-25T13:15:06.519 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 8.9358e-05 s, 5.7 MB/s 2024-04-25T13:15:06.521 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:15:06.577 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-25 13:14:56.198247288 +0000 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-25 13:12:47.243966543 +0000 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-25 13:12:47.243966543 +0000 2024-04-25T13:15:06.633 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-04-25 13:12:47.243966543 +0000 2024-04-25T13:15:06.633 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:15:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-25T13:15:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-25T13:15:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 8.7522e-05 s, 5.8 MB/s 2024-04-25T13:15:06.698 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:15:06.753 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:06.753 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:06.753 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:15:06.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:15:06.769 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-04-25T13:15:06.823 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-25 13:14:54.488796677 +0000 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-25 13:12:42.434096662 +0000 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-25 13:12:42.434096662 +0000 2024-04-25T13:15:06.824 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-25 13:12:42.434096662 +0000 2024-04-25T13:15:06.824 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:15:06.887 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-25T13:15:06.887 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-25T13:15:06.887 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000206388 s, 2.5 MB/s 2024-04-25T13:15:06.888 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:15:06.944 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-04-25T13:15:06.999 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:15:06.999 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:06.999 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T13:15:07.000 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:07.000 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:07.000 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-25 13:14:54.488796677 +0000 2024-04-25T13:15:07.000 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-25 13:12:42.771088837 +0000 2024-04-25T13:15:07.000 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-25 13:12:42.771088837 +0000 2024-04-25T13:15:07.000 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-25 13:12:42.771088837 +0000 2024-04-25T13:15:07.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000170302 s, 3.0 MB/s 2024-04-25T13:15:07.063 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:15:07.117 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-04-25T13:15:07.172 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-25 13:14:54.489796656 +0000 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-25 13:12:43.109080988 +0000 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-25 13:12:43.109080988 +0000 2024-04-25T13:15:07.173 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-25 13:12:43.109080988 +0000 2024-04-25T13:15:07.174 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:15:07.235 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-25T13:15:07.235 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-25T13:15:07.235 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000180072 s, 2.8 MB/s 2024-04-25T13:15:07.236 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:15:07.292 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-04-25T13:15:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:15:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:07.345 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T13:15:07.345 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:07.346 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:07.346 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-25 13:14:54.489796656 +0000 2024-04-25T13:15:07.346 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-25 13:12:43.655068310 +0000 2024-04-25T13:15:07.346 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-25 13:12:43.655068310 +0000 2024-04-25T13:15:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-25 13:12:43.655068310 +0000 2024-04-25T13:15:07.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:15:07.407 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-25T13:15:07.408 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-25T13:15:07.408 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000224451 s, 2.3 MB/s 2024-04-25T13:15:07.409 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:15:07.464 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:07.465 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:15:07.465 INFO:tasks.ceph:Generating config... 2024-04-25T13:15:07.466 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T13:15:07.466 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T13:15:07.466 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T13:15:07.466 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T13:15:07.466 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T13:15:07.466 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T13:15:07.466 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T13:15:07.466 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T13:15:07.466 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-25T13:15:07.467 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T13:15:07.468 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T13:15:07.468 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T13:15:07.468 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T13:15:07.468 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T13:15:07.469 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T13:15:07.470 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T13:15:07.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:07.545 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T13:15:07.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T13:15:07.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:07.619 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2024-04-25T13:15:07.619 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T13:15:07.620 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:07.620 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:15:07.675 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid 8f4a7b84-1cd1-4957-a762-8e7959ae0a88 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = quincy 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:fsid 8f4a7b84-1cd1-4957-a762-8e7959ae0a88 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2024-04-25T13:15:07.763284+0000 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-04-25T13:15:07.763284+0000 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 17 (quincy) 2024-04-25T13:15:07.762 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2024-04-25T13:15:07.763 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2024-04-25T13:15:07.763 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-04-25T13:15:07.763 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2024-04-25T13:15:07.763 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T13:15:07.764 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:15:07.779 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8f4a7b84-1cd1-4957-a762-8e7959ae0a88... 2024-04-25T13:15:07.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:15:07.822 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:15:07.861 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2024-04-25T13:15:07.862 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2024-04-25T13:15:07.863 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2024-04-25T13:15:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 8f4a7b84-1cd1-4957-a762-8e7959ae0a88 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2024-04-25T13:15:07.865 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug trim objects = true 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.866 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 20 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 20 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 10 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: mon client directed command retry = 5 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay max = 1 2024-04-25T13:15:07.867 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay type = client mds 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject socket failures = 2500 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: osd blocked scrub grace period = 3600 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: osd max markdown count = 1000 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:07.868 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2024-04-25T13:15:07.869 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: mon down mkfs grace = 300 2024-04-25T13:15:07.870 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: client_shutdown_timeout = 120 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2024-04-25T13:15:07.871 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal fragment size max = 10000 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal merge size = 5 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal split bits = 3 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal split size = 100 2024-04-25T13:15:07.872 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: mds oft prefetch dirfrags = True 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: mds_dir_prefetch = True 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: mon client directed command retry = 5 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay max = 1 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay type = client mds osd 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject socket failures = 2500 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-04-25T13:15:07.873 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.875 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-04-25T13:15:07.876 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-04-25T13:15:07.876 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.876 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-04-25T13:15:07.876 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-04-25T13:15:07.876 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.876 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:15:07.876 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-04-25T13:15:07.877 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-04-25T13:15:07.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:15:07.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:15:07.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-04-25T13:15:07.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:15:07.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-04-25T13:15:07.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:15:07.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:15:07.879 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-04-25T13:15:07.879 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.879 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:15:07.879 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.879 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-04-25T13:15:07.879 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-04-25T13:15:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-04-25T13:15:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-04-25T13:15:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-04-25T13:15:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.26,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-04-25T13:15:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 8f4a7b84-1cd1-4957-a762-8e7959ae0a88 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:15:07.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-04-25T13:15:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.883 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-04-25T13:15:07.883 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-04-25T13:15:07.883 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.883 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:15:07.883 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.883 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-04-25T13:15:07.883 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.884 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-04-25T13:15:07.884 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.884 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:15:07.884 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-04-25T13:15:07.884 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.884 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-04-25T13:15:07.884 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-04-25T13:15:07.885 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-04-25T13:15:07.885 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-04-25T13:15:07.885 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-04-25T13:15:07.885 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-04-25T13:15:07.885 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-25T13:15:07.885 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-04-25T13:15:07.885 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: mon client directed command retry = 5 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay max = 1 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay type = client mds 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject socket failures = 2500 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: osd blocked scrub grace period = 3600 2024-04-25T13:15:07.886 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: osd max markdown count = 1000 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-04-25T13:15:07.887 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-04-25T13:15:07.888 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:15:07.889 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: client_shutdown_timeout = 120 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-04-25T13:15:07.890 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal fragment size max = 10000 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal merge size = 5 2024-04-25T13:15:07.891 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split bits = 3 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split size = 100 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds oft prefetch dirfrags = True 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds_dir_prefetch = True 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: mon client directed command retry = 5 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay max = 1 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay type = client mds osd 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject socket failures = 2500 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-04-25T13:15:07.892 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-04-25T13:15:07.893 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-04-25T13:15:07.893 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T13:15:07.893 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T13:15:07.969 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T13:15:07.969 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:07.969 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T13:15:07.984 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:07.984 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T13:15:08.039 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:15:08.039 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:08.039 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:15:08.039 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:08.113 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:08.114 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:08.169 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:15:08.169 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:08.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:15:08.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:08.202 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:08.202 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:08.257 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T13:15:08.257 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T13:15:08.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:15:08.307 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:15:08.309 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:15:08.386 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:15:08.388 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T13:15:08.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:15:08.438 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:15:08.441 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T13:15:08.464 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:15:08.554 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:15:08.557 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T13:15:08.581 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T13:15:08.671 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T13:15:08.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T13:15:08.697 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:15:08.747 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:15:08.749 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T13:15:08.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:15:08.860 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:15:08.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T13:15:08.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T13:15:08.974 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T13:15:08.977 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T13:15:09.000 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T13:15:09.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T13:15:09.041 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T13:15:09.053 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T13:15:09.053 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:15:09.054 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:09.117 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:09.117 INFO:tasks.ceph:role: osd.0 2024-04-25T13:15:09.117 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:15:09.118 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:15:09.180 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:09.181 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:09.213 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-25T13:15:09.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-25T13:15:09.215 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:09.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:09.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:09.419 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:09.419 INFO:tasks.ceph:role: osd.1 2024-04-25T13:15:09.419 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:15:09.419 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:15:09.483 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:09.483 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:09.483 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:09.483 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:09.483 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:09.483 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:09.484 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:09.484 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:09.484 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:09.484 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:09.516 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-25T13:15:09.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-25T13:15:09.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:09.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:09.653 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:09.718 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:09.718 INFO:tasks.ceph:role: osd.2 2024-04-25T13:15:09.718 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:15:09.718 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:15:09.782 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:09.782 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:09.782 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:09.782 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:09.783 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:09.783 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:09.783 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:09.783 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:09.783 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:09.783 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:09.814 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-25T13:15:09.816 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-25T13:15:09.816 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:09.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:09.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:10.017 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:10.018 INFO:tasks.ceph:role: osd.3 2024-04-25T13:15:10.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:15:10.018 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:15:10.081 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:10.081 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:10.081 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:10.081 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:10.081 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:10.082 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:10.082 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:10.082 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:10.082 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:10.082 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-25T13:15:10.115 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-25T13:15:10.115 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:10.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:10.256 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:10.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:10.346+0000 7f88aed68640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T13:15:10.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:10.346+0000 7f88aed68640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T13:15:10.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:10.346+0000 7f88aed68640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:10.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:10.346+0000 7f88aed68640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:10.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:10.347+0000 7f88aed68640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:10.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:10.347+0000 7f88aed68640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T13:15:13.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:13.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:13.312+0000 7fd3cf40c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T13:15:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:13.312+0000 7fd3cf40c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T13:15:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:13.312+0000 7fd3cf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:13.312+0000 7fd3cf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:13.312+0000 7fd3cf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:13.312+0000 7fd3cf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T13:15:16.165 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:16.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:16.282+0000 7ffbb07a3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T13:15:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:16.282+0000 7ffbb07a3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T13:15:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:16.282+0000 7ffbb07a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:16.282+0000 7ffbb07a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:16.282+0000 7ffbb07a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:16.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:16.283+0000 7ffbb07a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T13:15:19.129 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:19.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:19.249+0000 7f0ec4526640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T13:15:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:19.249+0000 7f0ec4526640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T13:15:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:19.249+0000 7f0ec4526640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:19.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:19.249+0000 7f0ec4526640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:19.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:19.249+0000 7f0ec4526640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:19.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:19.250+0000 7f0ec4526640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T13:15:22.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:22.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:22.154 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:22.154 INFO:tasks.ceph:role: osd.4 2024-04-25T13:15:22.154 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:15:22.155 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:15:22.229 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:22.230 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:22.738 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-25T13:15:22.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-25T13:15:22.741 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:22.869 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:22.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:22.969 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:22.969 INFO:tasks.ceph:role: osd.5 2024-04-25T13:15:22.969 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:15:22.969 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:15:23.042 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:23.042 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:23.042 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:23.042 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:23.042 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:23.042 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:23.043 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:23.043 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:23.043 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:23.043 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:23.512 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-25T13:15:23.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-25T13:15:23.514 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:23.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:23.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:23.692 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:23.692 INFO:tasks.ceph:role: osd.6 2024-04-25T13:15:23.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:15:23.692 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:23.763 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:24.254 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-25T13:15:24.256 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-25T13:15:24.256 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:24.400 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:24.427 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:24.491 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:24.491 INFO:tasks.ceph:role: osd.7 2024-04-25T13:15:24.491 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:15:24.491 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:24.563 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:25.086 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-25T13:15:25.091 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-25T13:15:25.091 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:25.243 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:25.274 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:25.369+0000 7fae05e31640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T13:15:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:25.370+0000 7fae05e31640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T13:15:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:25.370+0000 7fae05e31640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:25.370+0000 7fae05e31640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:25.370+0000 7fae05e31640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:25.370+0000 7fae05e31640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T13:15:28.220 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:28.246 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:28.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:28.332+0000 7f1b2bc1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T13:15:28.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:28.332+0000 7f1b2bc1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T13:15:28.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:28.332+0000 7f1b2bc1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:28.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:28.332+0000 7f1b2bc1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:28.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:28.332+0000 7f1b2bc1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:28.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:28.333+0000 7f1b2bc1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T13:15:31.177 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:31.204 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:31.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:31.291+0000 7f5adca32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T13:15:31.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:31.291+0000 7f5adca32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T13:15:31.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:31.291+0000 7f5adca32640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:31.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:31.291+0000 7f5adca32640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:31.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:31.291+0000 7f5adca32640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:31.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:31.292+0000 7f5adca32640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T13:15:34.146 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:34.174 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:34.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:34.267+0000 7f04c5424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T13:15:34.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:34.268+0000 7f04c5424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T13:15:34.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:34.268+0000 7f04c5424640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:34.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:34.268+0000 7f04c5424640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:34.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:34.268+0000 7f04c5424640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:34.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:34.268+0000 7f04c5424640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T13:15:35.913 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:35.916 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:37.121 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:37.148 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T13:15:37.148 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.149 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T13:15:37.178 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T13:15:37.247 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T13:15:37.315 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T13:15:37.381 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T13:15:37.448 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T13:15:37.514 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T13:15:37.580 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:37.580 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T13:15:37.645 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:37.645 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T13:15:37.674 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:37.674 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T13:15:37.742 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:37.742 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T13:15:37.808 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:37.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T13:15:37.873 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:37.874 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T13:15:37.938 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:37.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T13:15:38.001 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:38.001 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T13:15:38.065 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:38.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T13:15:38.128 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:38.129 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T13:15:38.147 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T13:15:38.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:15:38.190 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:15:38.212 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2024-04-25T13:15:38.212 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypm7P9gEhAAE8Lr1bCVLw4wzdnzE9PiJQ== 2024-04-25T13:15:38.212 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-04-25T13:15:38.212 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypmd206GhAAmjK74mN/36qINQPjhniP/Q== 2024-04-25T13:15:38.212 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-04-25T13:15:38.212 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypmPqscIRAAYgFmeTImjhOz/4q1G9dSuA== 2024-04-25T13:15:38.212 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypmFggVKBAA193oN3EUK7+b9h8dHAKgyA== 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBeVypmS1O0FBAAf93vEb5pNnTGrlTMbRrDhA== 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBhVypmTxOmEhAAuEMq2yRgZEqRHj5M13OvBA== 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBkVypm7SvwEBAA7MOv9ID9l38YkU4AR6CKwg== 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBnVypmFCP3DhAAJr9noH5wx7Lnp5is/ssRBg== 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypmU5UaFxAAGeVCEDQy8x4FA75dVb9klA== 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypmxhecLBAAE8aWDFXj2Vkmz8s4MX4DQg== 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-04-25T13:15:38.213 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypmhNJgMxAA6UvIMUYJI9EBO+l4qWvVig== 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBcVypmrFInOhAAilLmBYim1Ng5iHKZ6xEVtw== 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBtVypm1Y4TFhAAiy3jrGzHqAY9l7AS1pbtvQ== 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBwVypmJBPdExAAxDpdLBIN8XzH/p0xXZWbwQ== 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBzVypmIx1pERAAA1G9f97Gkl3EeD74HFAvcg== 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB2VypmFP4QEBAADVPuVHacK/NXHfGLjWMz6g== 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2024-04-25T13:15:38.214 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBdVypmoZeHAhAAhOD9kQzgn+GBlm/c2QKBkA== 2024-04-25T13:15:38.215 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2024-04-25T13:15:38.215 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypm7P9gEhAAE8Lr1bCVLw4wzdnzE9PiJQ== 2024-04-25T13:15:38.215 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-04-25T13:15:38.215 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypmd206GhAAmjK74mN/36qINQPjhniP/Q== 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypmPqscIRAAYgFmeTImjhOz/4q1G9dSuA== 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypmFggVKBAA193oN3EUK7+b9h8dHAKgyA== 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBeVypmS1O0FBAAf93vEb5pNnTGrlTMbRrDhA== 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBhVypmTxOmEhAAuEMq2yRgZEqRHj5M13OvBA== 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBkVypm7SvwEBAA7MOv9ID9l38YkU4AR6CKwg== 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBnVypmFCP3DhAAJr9noH5wx7Lnp5is/ssRBg== 2024-04-25T13:15:38.216 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypmU5UaFxAAGeVCEDQy8x4FA75dVb9klA== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypmxhecLBAAE8aWDFXj2Vkmz8s4MX4DQg== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypmhNJgMxAA6UvIMUYJI9EBO+l4qWvVig== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBcVypmrFInOhAAilLmBYim1Ng5iHKZ6xEVtw== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBtVypm1Y4TFhAAiy3jrGzHqAY9l7AS1pbtvQ== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBwVypmJBPdExAAxDpdLBIN8XzH/p0xXZWbwQ== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBzVypmIx1pERAAA1G9f97Gkl3EeD74HFAvcg== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB2VypmFP4QEBAADVPuVHacK/NXHfGLjWMz6g== 2024-04-25T13:15:38.217 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2024-04-25T13:15:38.218 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBdVypmoZeHAhAAhOD9kQzgn+GBlm/c2QKBkA== 2024-04-25T13:15:38.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:38.261 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:38.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.320 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.428 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.430 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.482 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.534 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.583 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:38.686 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:38.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.788 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.842 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.844 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:38.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.949 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:38.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:39.001 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:39.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:39.053 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:39.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:15:39.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:15:39.155 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T13:15:39.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T13:15:39.179 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:39.274 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T13:15:39.298 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T13:15:39.322 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:39.416 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T13:15:39.439 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T13:15:39.502 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:39.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T13:15:39.619 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:39.621 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:39.674 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T13:15:39.674 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T13:15:39.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T13:15:39.677 INFO:tasks.ceph.mon.a:Started 2024-04-25T13:15:39.677 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T13:15:39.677 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T13:15:39.717 INFO:tasks.ceph.mon.b:Started 2024-04-25T13:15:39.717 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T13:15:39.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T13:15:39.719 INFO:tasks.ceph.mon.c:Started 2024-04-25T13:15:39.719 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T13:15:39.719 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T13:15:39.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T13:15:39.721 INFO:tasks.ceph.mgr.y:Started 2024-04-25T13:15:39.721 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T13:15:39.721 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T13:15:39.723 INFO:tasks.ceph.mgr.x:Started 2024-04-25T13:15:39.724 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T13:15:39.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T13:15:39.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.824+0000 7fa4d5d64640 1 Processor -- start 2024-04-25T13:15:39.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.824+0000 7fa4d5d64640 1 -- start start 2024-04-25T13:15:39.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.824+0000 7fa4d5d64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:39.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4d5d64640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:39.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4d5d64640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4d5d64640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d0160320 con 0x7fa4d00c7ea0 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4d5d64640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d0072210 con 0x7fa4d00740c0 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4d5d64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d00724f0 con 0x7fa4d0155f40 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39024/0 (socket says 172.21.15.26:39024) 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 learned_addr learned my addr 172.21.15.26:0/3960100086 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:39.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:39.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:39.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:39.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:39.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:39.825+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.026+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:40.427+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:41.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4ceffd640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:41.228+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 msgr2=0x7fa4d0074d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d0155f40 0x7fa4d0074d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 msgr2=0x7fa4d0075290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.169:3300/0 conn(0x7fa4d00740c0 0x7fa4d0075290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 -- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 msgr2=0x7fa4d0160970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 --2- 172.21.15.26:0/3960100086 >> v2:172.21.15.26:3300/0 conn(0x7fa4d00c7ea0 0x7fa4d0160970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 -- 172.21.15.26:0/3960100086 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d00727d0 con 0x7fa4b80036b0 2024-04-25T13:15:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:42.826+0000 7fa4cd7fa640 1 -- 172.21.15.26:0/3960100086 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b800c100 con 0x7fa4b80073b0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.995+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618765043 0 0) 0x7fa4b800c100 con 0x7fa4b80073b0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.995+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4bc003520 con 0x7fa4b80073b0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808652032 0 0) 0x7fa4d00727d0 con 0x7fa4b80036b0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b800c100 con 0x7fa4b80036b0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 856795153 0 0) 0x7fa4b800c100 con 0x7fa4b80036b0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 >> v1:172.21.15.169:6789/0 conn(0x7fa4b80073b0 legacy=0x7fa4b8009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b800d3a0 con 0x7fa4b80036b0 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7fa4c000d580 con 0x7fa4b80036b0 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 >> v1:172.21.15.26:6789/0 conn(0x7fa4b80036b0 legacy=0x7fa4b8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4cffff640 1 -- 172.21.15.26:0/3960100086 reap_dead start 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc003bc0 0x7fa4bc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc0099b0 0x7fa4bc00bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc00c310 con 0x7fa4bc003bc0 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc00c4c0 con 0x7fa4bc0099b0 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc00c6c0 con 0x7fa4bc004800 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc003bc0 0x7fa4bc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.996+0000 7fa4cffff640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc0099b0 0x7fa4bc00bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.997+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.997+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 msgr2=0x7fa4bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.997+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.997+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc0099b0 msgr2=0x7fa4bc00bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.997+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc0099b0 0x7fa4bc00bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.997+0000 7fa4cf7fe640 1 -- 172.21.15.26:0/3960100086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b800c100 con 0x7fa4bc003bc0 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.997+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:15:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.998+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc003bc0 0x7fa4bc003fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006fd0 tx=0x7fa4bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26e49ada3986c94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0039070 con 0x7fa4bc003bc0 2024-04-25T13:15:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c0034410 con 0x7fa4bc003bc0 2024-04-25T13:15:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4ce7fc640 1 -- 172.21.15.26:0/3960100086 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000de10 con 0x7fa4bc003bc0 2024-04-25T13:15:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4d5d64640 1 -- 172.21.15.26:0/3960100086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc003bc0 msgr2=0x7fa4bc003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc003bc0 0x7fa4bc003fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006fd0 tx=0x7fa4bc005830 comp rx=0 tx=0).stop 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4d5d64640 1 -- 172.21.15.26:0/3960100086 shutdown_connections 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc0099b0 0x7fa4bc00bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/3960100086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc003bc0 0x7fa4bc003fa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:44.999+0000 7fa4d5d64640 1 -- 172.21.15.26:0/3960100086 >> 172.21.15.26:0/3960100086 conn(0x7fa4d006b920 msgr2=0x7fa4d006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.000+0000 7fa4d5d64640 1 -- 172.21.15.26:0/3960100086 shutdown_connections 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.000+0000 7fa4d5d64640 1 -- 172.21.15.26:0/3960100086 wait complete. 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.002+0000 7fa4d5d64640 1 Processor -- start 2024-04-25T13:15:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.002+0000 7fa4d5d64640 1 -- start start 2024-04-25T13:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4d5d64640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc003bc0 0x7fa4d0160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4d5d64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4d00ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4d5d64640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc0099b0 0x7fa4d01f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4d5d64640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0156320 con 0x7fa4bc0099b0 2024-04-25T13:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4d5d64640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0072d90 con 0x7fa4bc003bc0 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4d5d64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d015fed0 con 0x7fa4bc004800 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4cffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc0099b0 0x7fa4d01f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.003+0000 7fa4cffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc0099b0 0x7fa4d01f7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40304/0 (socket says 172.21.15.26:40304) 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cffff640 1 -- 172.21.15.26:0/2828071989 learned_addr learned my addr 172.21.15.26:0/2828071989 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4d00ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc003bc0 0x7fa4d0160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cffff640 1 -- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 msgr2=0x7fa4d00ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cffff640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4d00ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cffff640 1 -- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc003bc0 msgr2=0x7fa4d0160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cffff640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc003bc0 0x7fa4d0160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cffff640 1 -- 172.21.15.26:0/2828071989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d014e330 con 0x7fa4bc0099b0 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4ceffd640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4d00ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cf7fe640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc003bc0 0x7fa4d0160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.004+0000 7fa4cffff640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc0099b0 0x7fa4d01f7b60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00c8330 tx=0x7fa4c8008db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.005+0000 7fa4b7fff640 1 -- 172.21.15.26:0/2828071989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007a50 con 0x7fa4bc0099b0 2024-04-25T13:15:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.005+0000 7fa4b7fff640 1 -- 172.21.15.26:0/2828071989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c801f070 con 0x7fa4bc0099b0 2024-04-25T13:15:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.005+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d0161090 con 0x7fa4bc0099b0 2024-04-25T13:15:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.005+0000 7fa4b7fff640 1 -- 172.21.15.26:0/2828071989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007e50 con 0x7fa4bc0099b0 2024-04-25T13:15:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.005+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d014e8b0 con 0x7fa4bc0099b0 2024-04-25T13:15:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.005+0000 7fa4b7fff640 1 -- 172.21.15.26:0/2828071989 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa4c8005d10 con 0x7fa4bc0099b0 2024-04-25T13:15:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.005+0000 7fa4b7fff640 1 -- 172.21.15.26:0/2828071989 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa4c80239d0 con 0x7fa4bc0099b0 2024-04-25T13:15:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.006+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d0154f60 con 0x7fa4bc0099b0 2024-04-25T13:15:45.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.009+0000 7fa4b7fff640 1 -- 172.21.15.26:0/2828071989 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa4d0154f60 con 0x7fa4bc0099b0 2024-04-25T13:15:45.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.077+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa4d0068f50 con 0x7fa4bc0099b0 2024-04-25T13:15:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.078+0000 7fa4b7fff640 1 -- 172.21.15.26:0/2828071989 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa4c8023410 con 0x7fa4bc0099b0 2024-04-25T13:15:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc0099b0 msgr2=0x7fa4d01f7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc0099b0 0x7fa4d01f7b60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00c8330 tx=0x7fa4c8008db0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 shutdown_connections 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4bc0099b0 0x7fa4d01f7b60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4bc004800 0x7fa4d00ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 --2- 172.21.15.26:0/2828071989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4bc003bc0 0x7fa4d0160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 >> 172.21.15.26:0/2828071989 conn(0x7fa4d006b920 msgr2=0x7fa4d01535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 shutdown_connections 2024-04-25T13:15:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:45.079+0000 7fa4d5d64640 1 -- 172.21.15.26:0/2828071989 wait complete. 2024-04-25T13:15:45.090 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T13:15:45.090 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T13:15:45.090 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:45.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T13:15:45.108 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:45.108+0000 7fcdbaa12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:15:45.116 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:45.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T13:15:45.181 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:45.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T13:15:45.246 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:15:45.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T13:15:45.277 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:45.277+0000 7fcdbaa12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:45.311 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:45.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T13:15:45.332 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:45.331+0000 7fcdbaa12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:15:45.334 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:45.335 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T13:15:45.399 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:45.399 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T13:15:45.462 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-25T13:15:45.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T13:15:45.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 331ff599-600e-4525-a18c-1f77d3bbdc2d 0 2024-04-25T13:15:45.578 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:45.577+0000 7fcdbaa12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:15:45.626 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:45.625+0000 7fcdbaa12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:15:45.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.662+0000 7f753b8dc640 1 Processor -- start 2024-04-25T13:15:45.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.662+0000 7f753b8dc640 1 -- start start 2024-04-25T13:15:45.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f753b8dc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75340c8340 0x7f75340723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f753b8dc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f75340c8720 0x7f7534151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f753b8dc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7534157d70 con 0x7f7534158b10 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f753b8dc640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7534158680 con 0x7f75340c8340 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f753b8dc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f753415be10 con 0x7f75340c8720 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f7539e79640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f75340c8720 0x7f7534151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f7538e77640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f7534158b10 0x7f753415b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:37440/0 (socket says 172.21.15.169:37440) 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.663+0000 7f7538e77640 1 -- 172.21.15.169:0/1354751538 learned_addr learned my addr 172.21.15.169:0/1354751538 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f7539e79640 1 -- 172.21.15.169:0/1354751538 >> v2:172.21.15.26:3300/0 conn(0x7f75340c8340 msgr2=0x7f75340723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f7539e79640 1 --2- 172.21.15.169:0/1354751538 >> v2:172.21.15.26:3300/0 conn(0x7f75340c8340 0x7f75340723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f7539e79640 1 -- 172.21.15.169:0/1354751538 >> v1:172.21.15.169:6789/0 conn(0x7f7534158b10 legacy=0x7f753415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f7539e79640 1 -- 172.21.15.169:0/1354751538 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753415c0f0 con 0x7f75340c8720 2024-04-25T13:15:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f752bfff640 1 -- 172.21.15.169:0/1354751538 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773560522 0 0) 0x7f7534157d70 con 0x7f7534158b10 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f7539e79640 1 --2- 172.21.15.169:0/1354751538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75340c8720 0x7f7534151b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75340ca160 tx=0x7f752c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa7c164d674bedf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f752bfff640 1 -- 172.21.15.169:0/1354751538 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c007740 con 0x7f75340c8720 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f752bfff640 1 -- 172.21.15.169:0/1354751538 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c0078e0 con 0x7f75340c8720 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.664+0000 7f752bfff640 1 -- 172.21.15.169:0/1354751538 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c007cb0 con 0x7f75340c8720 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 -- 172.21.15.169:0/1354751538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75340c8720 msgr2=0x7f7534151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 --2- 172.21.15.169:0/1354751538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75340c8720 0x7f7534151b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75340ca160 tx=0x7f752c02a680 comp rx=0 tx=0).stop 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 -- 172.21.15.169:0/1354751538 shutdown_connections 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 --2- 172.21.15.169:0/1354751538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75340c8720 0x7f7534151b10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 --2- 172.21.15.169:0/1354751538 >> v2:172.21.15.26:3300/0 conn(0x7f75340c8340 0x7f75340723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 -- 172.21.15.169:0/1354751538 >> 172.21.15.169:0/1354751538 conn(0x7f753406d660 msgr2=0x7f7534074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 -- 172.21.15.169:0/1354751538 shutdown_connections 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.665+0000 7f753b8dc640 1 -- 172.21.15.169:0/1354751538 wait complete. 2024-04-25T13:15:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.666+0000 7f753b8dc640 1 Processor -- start 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.666+0000 7f753b8dc640 1 -- start start 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f753b8dc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75340c8340 0x7f7534154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f753b8dc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75340c8720 0x7f7534147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f753b8dc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7534158b10 0x7f7534156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f753b8dc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75340728f0 con 0x7f75340c8720 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f753b8dc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7534158310 con 0x7f7534158b10 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f753b8dc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f753415ba70 con 0x7f75340c8340 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f7539678640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75340c8340 0x7f7534154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f7539e79640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7534158b10 0x7f7534156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f7539678640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75340c8340 0x7f7534154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:53798/0 (socket says 172.21.15.169:53798) 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f7539e79640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7534158b10 0x7f7534156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59440/0 (socket says 172.21.15.169:59440) 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f7539678640 1 -- 172.21.15.169:0/901315609 learned_addr learned my addr 172.21.15.169:0/901315609 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.667+0000 7f7538e77640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75340c8720 0x7f7534147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7539e79640 1 -- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75340c8340 msgr2=0x7f7534154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7539e79640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75340c8340 0x7f7534154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7539e79640 1 -- 172.21.15.169:0/901315609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75340c8720 msgr2=0x7f7534147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7539e79640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75340c8720 0x7f7534147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7539e79640 1 -- 172.21.15.169:0/901315609 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75340ca5d0 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7539678640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75340c8340 0x7f7534154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7539e79640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7534158b10 0x7f7534156d20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f752c031000 tx=0x7f752c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7529ffb640 1 -- 172.21.15.169:0/901315609 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c040070 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7529ffb640 1 -- 172.21.15.169:0/901315609 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c031c90 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75340ca8b0 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7529ffb640 1 -- 172.21.15.169:0/901315609 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c045680 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75340cae70 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7529ffb640 1 -- 172.21.15.169:0/901315609 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f752c039040 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.668+0000 7f7529ffb640 1 -- 172.21.15.169:0/901315609 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f752c03c460 con 0x7f7534158b10 2024-04-25T13:15:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.669+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7534068f50 con 0x7f7534158b10 2024-04-25T13:15:45.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.672+0000 7f7529ffb640 1 -- 172.21.15.169:0/901315609 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f752c053080 con 0x7f7534158b10 2024-04-25T13:15:45.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.743+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "331ff599-600e-4525-a18c-1f77d3bbdc2d", "id": 0} v 0) -- 0x7f7534071830 con 0x7f7534158b10 2024-04-25T13:15:45.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.746+0000 7f7529ffb640 1 -- 172.21.15.169:0/901315609 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "331ff599-600e-4525-a18c-1f77d3bbdc2d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f752c007840 con 0x7f7534158b10 2024-04-25T13:15:45.747 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7534158b10 msgr2=0x7f7534156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7534158b10 0x7f7534156d20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f752c031000 tx=0x7f752c004a40 comp rx=0 tx=0).stop 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 shutdown_connections 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7534158b10 0x7f7534156d20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75340c8720 0x7f7534147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 --2- 172.21.15.169:0/901315609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75340c8340 0x7f7534154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 >> 172.21.15.169:0/901315609 conn(0x7f753406d660 msgr2=0x7f75340c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 shutdown_connections 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.747+0000 7f753b8dc640 1 -- 172.21.15.169:0/901315609 wait complete. 2024-04-25T13:15:45.762 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new ede2a9c7-4875-4495-b239-0f4c98a6e7e1 1 2024-04-25T13:15:45.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.899+0000 7efd240a9640 1 Processor -- start 2024-04-25T13:15:45.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.899+0000 7efd240a9640 1 -- start start 2024-04-25T13:15:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd240a9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144220 0x7efd1c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd240a9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efd1c144600 0x7efd1c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd240a9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd1c15e780 con 0x7efd1c0cb8c0 2024-04-25T13:15:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd240a9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7efd1c15f570 con 0x7efd1c144600 2024-04-25T13:15:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd240a9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efd1c15e9f0 con 0x7efd1c144220 2024-04-25T13:15:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21e45640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144220 0x7efd1c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21e45640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144220 0x7efd1c15bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:53810/0 (socket says 172.21.15.169:53810) 2024-04-25T13:15:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21e45640 1 -- 172.21.15.169:0/3135650090 learned_addr learned my addr 172.21.15.169:0/3135650090 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21644640 1 --2- 172.21.15.169:0/3135650090 >> v2:172.21.15.26:3300/0 conn(0x7efd1c144600 0x7efd1c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21e45640 1 -- 172.21.15.169:0/3135650090 >> v2:172.21.15.26:3300/0 conn(0x7efd1c144600 msgr2=0x7efd1c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21e45640 1 --2- 172.21.15.169:0/3135650090 >> v2:172.21.15.26:3300/0 conn(0x7efd1c144600 0x7efd1c0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21e45640 1 -- 172.21.15.169:0/3135650090 >> v1:172.21.15.26:6789/0 conn(0x7efd1c0cb8c0 legacy=0x7efd1c0c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.900+0000 7efd21e45640 1 -- 172.21.15.169:0/3135650090 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c15ecd0 con 0x7efd1c144220 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.901+0000 7efd21e45640 1 --2- 172.21.15.169:0/3135650090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144220 0x7efd1c15bc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd18009870 tx=0x7efd1802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83b8b2b416d816b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.901+0000 7efd20e43640 1 -- 172.21.15.169:0/3135650090 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18037070 con 0x7efd1c144220 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.901+0000 7efd20e43640 1 -- 172.21.15.169:0/3135650090 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1802ae50 con 0x7efd1c144220 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.901+0000 7efd20e43640 1 -- 172.21.15.169:0/3135650090 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18032860 con 0x7efd1c144220 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.901+0000 7efd240a9640 1 -- 172.21.15.169:0/3135650090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144220 msgr2=0x7efd1c15bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.901+0000 7efd240a9640 1 --2- 172.21.15.169:0/3135650090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144220 0x7efd1c15bc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd18009870 tx=0x7efd1802a300 comp rx=0 tx=0).stop 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.902+0000 7efd240a9640 1 -- 172.21.15.169:0/3135650090 shutdown_connections 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.902+0000 7efd240a9640 1 --2- 172.21.15.169:0/3135650090 >> v2:172.21.15.26:3300/0 conn(0x7efd1c144600 0x7efd1c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.902+0000 7efd240a9640 1 --2- 172.21.15.169:0/3135650090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144220 0x7efd1c15bc00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.902+0000 7efd240a9640 1 -- 172.21.15.169:0/3135650090 >> 172.21.15.169:0/3135650090 conn(0x7efd1c06b920 msgr2=0x7efd1c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.902+0000 7efd240a9640 1 -- 172.21.15.169:0/3135650090 shutdown_connections 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.902+0000 7efd240a9640 1 -- 172.21.15.169:0/3135650090 wait complete. 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 Processor -- start 2024-04-25T13:15:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 -- start start 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd1c0cb8c0 0x7efd1c1f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd1c144220 0x7efd1c0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144600 0x7efd1c1e7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c0ca700 con 0x7efd1c0cb8c0 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c15f290 con 0x7efd1c144220 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.903+0000 7efd240a9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efd1c0ca880 con 0x7efd1c144600 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd1c144220 0x7efd1c0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd22646640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144600 0x7efd1c1e7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd1c144220 0x7efd1c0c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59444/0 (socket says 172.21.15.169:59444) 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 -- 172.21.15.169:0/2697449235 learned_addr learned my addr 172.21.15.169:0/2697449235 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21e45640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd1c0cb8c0 0x7efd1c1f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 -- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144600 msgr2=0x7efd1c1e7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144600 0x7efd1c1e7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 -- 172.21.15.169:0/2697449235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd1c0cb8c0 msgr2=0x7efd1c1f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd1c0cb8c0 0x7efd1c1f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 -- 172.21.15.169:0/2697449235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c1e4920 con 0x7efd1c144220 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd22646640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144600 0x7efd1c1e7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd21644640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd1c144220 0x7efd1c0c7ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e870 tx=0x7efd0c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd127fc640 1 -- 172.21.15.169:0/2697449235 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c017070 con 0x7efd1c144220 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd127fc640 1 -- 172.21.15.169:0/2697449235 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c00c940 con 0x7efd1c144220 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd127fc640 1 -- 172.21.15.169:0/2697449235 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00cd30 con 0x7efd1c144220 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1c1e4be0 con 0x7efd1c144220 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1c1e51a0 con 0x7efd1c144220 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd127fc640 1 -- 172.21.15.169:0/2697449235 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efd0c01a070 con 0x7efd1c144220 2024-04-25T13:15:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.904+0000 7efd127fc640 1 -- 172.21.15.169:0/2697449235 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efd0c01c800 con 0x7efd1c144220 2024-04-25T13:15:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.905+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1c068f50 con 0x7efd1c144220 2024-04-25T13:15:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.907+0000 7efd127fc640 1 -- 172.21.15.169:0/2697449235 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7efd0c01ca00 con 0x7efd1c144220 2024-04-25T13:15:45.911 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:45.912+0000 7f84767be040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:15:45.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.980+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ede2a9c7-4875-4495-b239-0f4c98a6e7e1", "id": 1} v 0) -- 0x7efd1c0ce3f0 con 0x7efd1c144220 2024-04-25T13:15:45.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.983+0000 7efd127fc640 1 -- 172.21.15.169:0/2697449235 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ede2a9c7-4875-4495-b239-0f4c98a6e7e1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efd0c01cbe0 con 0x7efd1c144220 2024-04-25T13:15:45.984 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-04-25T13:15:45.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd1c144220 msgr2=0x7efd1c0c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd1c144220 0x7efd1c0c7ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e870 tx=0x7efd0c00ed30 comp rx=0 tx=0).stop 2024-04-25T13:15:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 shutdown_connections 2024-04-25T13:15:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd1c144600 0x7efd1c1e7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd1c144220 0x7efd1c0c7ad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 --2- 172.21.15.169:0/2697449235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd1c0cb8c0 0x7efd1c1f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 >> 172.21.15.169:0/2697449235 conn(0x7efd1c06b920 msgr2=0x7efd1c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 shutdown_connections 2024-04-25T13:15:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:45.984+0000 7efd240a9640 1 -- 172.21.15.169:0/2697449235 wait complete. 2024-04-25T13:15:45.996 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new a4427a0e-b66e-4b50-95da-715cdef3cbb8 2 2024-04-25T13:15:46.062 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:46.062+0000 7f84767be040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:46.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.093+0000 7ff98ae20640 1 Processor -- start 2024-04-25T13:15:46.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.093+0000 7ff98ae20640 1 -- start start 2024-04-25T13:15:46.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.093+0000 7ff98ae20640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9840c87e0 0x7ff98415f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.093+0000 7ff98ae20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff984073ce0 0x7ff9840ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.093+0000 7ff98ae20640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98415f7b0 con 0x7ff9840cec90 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff98ae20640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff98415b3f0 con 0x7ff9840c87e0 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff98ae20640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff98415b6d0 con 0x7ff984073ce0 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff983fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff984073ce0 0x7ff9840ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff9893bd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff9840cec90 0x7ff98415cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:37444/0 (socket says 172.21.15.169:37444) 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff9893bd640 1 -- 172.21.15.169:0/2431270347 learned_addr learned my addr 172.21.15.169:0/2431270347 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff988bbc640 1 --2- 172.21.15.169:0/2431270347 >> v2:172.21.15.26:3300/0 conn(0x7ff9840c87e0 0x7ff98415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff9837fe640 1 -- 172.21.15.169:0/2431270347 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2473089612 0 0) 0x7ff98415f7b0 con 0x7ff9840cec90 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff9837fe640 1 -- 172.21.15.169:0/2431270347 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff974003520 con 0x7ff9840cec90 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff983fff640 1 -- 172.21.15.169:0/2431270347 >> v2:172.21.15.26:3300/0 conn(0x7ff9840c87e0 msgr2=0x7ff98415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff983fff640 1 --2- 172.21.15.169:0/2431270347 >> v2:172.21.15.26:3300/0 conn(0x7ff9840c87e0 0x7ff98415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff983fff640 1 -- 172.21.15.169:0/2431270347 >> v1:172.21.15.169:6789/0 conn(0x7ff9840cec90 legacy=0x7ff98415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.094+0000 7ff983fff640 1 -- 172.21.15.169:0/2431270347 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98415b9b0 con 0x7ff984073ce0 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff983fff640 1 --2- 172.21.15.169:0/2431270347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff984073ce0 0x7ff9840ce750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff9700097a0 tx=0x7ff97002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d08a8aa62d026c62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff9837fe640 1 -- 172.21.15.169:0/2431270347 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970037070 con 0x7ff984073ce0 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff9837fe640 1 -- 172.21.15.169:0/2431270347 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97002ae50 con 0x7ff984073ce0 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff9837fe640 1 -- 172.21.15.169:0/2431270347 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970032660 con 0x7ff984073ce0 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 -- 172.21.15.169:0/2431270347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff984073ce0 msgr2=0x7ff9840ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 --2- 172.21.15.169:0/2431270347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff984073ce0 0x7ff9840ce750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff9700097a0 tx=0x7ff97002a100 comp rx=0 tx=0).stop 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 -- 172.21.15.169:0/2431270347 shutdown_connections 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 --2- 172.21.15.169:0/2431270347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff984073ce0 0x7ff9840ce750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 --2- 172.21.15.169:0/2431270347 >> v2:172.21.15.26:3300/0 conn(0x7ff9840c87e0 0x7ff98415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 -- 172.21.15.169:0/2431270347 >> 172.21.15.169:0/2431270347 conn(0x7ff98406f840 msgr2=0x7ff984074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 -- 172.21.15.169:0/2431270347 shutdown_connections 2024-04-25T13:15:46.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.095+0000 7ff98ae20640 1 -- 172.21.15.169:0/2431270347 wait complete. 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.096+0000 7ff98ae20640 1 Processor -- start 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff98ae20640 1 -- start start 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff98ae20640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff984073ce0 0x7ff9841578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff98ae20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9840c87e0 0x7ff9841e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff98ae20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9840cec90 0x7ff9840cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff98ae20640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff9840c8bc0 con 0x7ff984073ce0 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff98ae20640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff98415bf70 con 0x7ff9840c87e0 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff98ae20640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff984074110 con 0x7ff9840cec90 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff983fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9840c87e0 0x7ff9841e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff983fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9840c87e0 0x7ff9841e5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59456/0 (socket says 172.21.15.169:59456) 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff9893bd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9840cec90 0x7ff9840cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.097+0000 7ff983fff640 1 -- 172.21.15.169:0/1238038708 learned_addr learned my addr 172.21.15.169:0/1238038708 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff988bbc640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff984073ce0 0x7ff9841578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff983fff640 1 -- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9840cec90 msgr2=0x7ff9840cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff983fff640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9840cec90 0x7ff9840cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff983fff640 1 -- 172.21.15.169:0/1238038708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff984073ce0 msgr2=0x7ff9841578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff983fff640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff984073ce0 0x7ff9841578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff983fff640 1 -- 172.21.15.169:0/1238038708 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff984155ed0 con 0x7ff9840c87e0 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff9893bd640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9840cec90 0x7ff9840cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff983fff640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9840c87e0 0x7ff9841e5110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff970035040 tx=0x7ff9700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff9817fa640 1 -- 172.21.15.169:0/1238038708 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970041070 con 0x7ff9840c87e0 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff9817fa640 1 -- 172.21.15.169:0/1238038708 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97003c460 con 0x7ff9840c87e0 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9841561b0 con 0x7ff9840c87e0 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff9817fa640 1 -- 172.21.15.169:0/1238038708 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970037040 con 0x7ff9840c87e0 2024-04-25T13:15:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff984156770 con 0x7ff9840c87e0 2024-04-25T13:15:46.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff9817fa640 1 -- 172.21.15.169:0/1238038708 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff97003a070 con 0x7ff9840c87e0 2024-04-25T13:15:46.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.098+0000 7ff9817fa640 1 -- 172.21.15.169:0/1238038708 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff970045a50 con 0x7ff9840c87e0 2024-04-25T13:15:46.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.099+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff984068f50 con 0x7ff9840c87e0 2024-04-25T13:15:46.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.101+0000 7ff9817fa640 1 -- 172.21.15.169:0/1238038708 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff970045cf0 con 0x7ff9840c87e0 2024-04-25T13:15:46.117 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:46.118+0000 7f84767be040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:15:46.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.175+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a4427a0e-b66e-4b50-95da-715cdef3cbb8", "id": 2} v 0) -- 0x7ff9840cc0b0 con 0x7ff9840c87e0 2024-04-25T13:15:46.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.178+0000 7ff9817fa640 1 -- 172.21.15.169:0/1238038708 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4427a0e-b66e-4b50-95da-715cdef3cbb8", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff970045630 con 0x7ff9840c87e0 2024-04-25T13:15:46.179 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-04-25T13:15:46.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9840c87e0 msgr2=0x7ff9841e5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9840c87e0 0x7ff9841e5110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff970035040 tx=0x7ff9700046c0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 shutdown_connections 2024-04-25T13:15:46.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9840cec90 0x7ff9840cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9840c87e0 0x7ff9841e5110 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 --2- 172.21.15.169:0/1238038708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff984073ce0 0x7ff9841578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 >> 172.21.15.169:0/1238038708 conn(0x7ff98406f840 msgr2=0x7ff984074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 shutdown_connections 2024-04-25T13:15:46.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.179+0000 7ff98ae20640 1 -- 172.21.15.169:0/1238038708 wait complete. 2024-04-25T13:15:46.191 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 173f6a99-2092-4c24-b834-e80e4b940259 3 2024-04-25T13:15:46.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.289+0000 7f6099d4b640 1 Processor -- start 2024-04-25T13:15:46.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.289+0000 7f6099d4b640 1 -- start start 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6099d4b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6094072c60 0x7f60940cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6099d4b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f609415b7b0 0x7f609415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6099d4b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609414ec90 con 0x7f60940cd4f0 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6099d4b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6094157ff0 con 0x7f609415b7b0 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6099d4b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6094158290 con 0x7f6094072c60 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6092ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6094072c60 0x7f60940cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f60937fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f60940cd4f0 0x7f60940c86f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:37456/0 (socket says 172.21.15.169:37456) 2024-04-25T13:15:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6092ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6094072c60 0x7f60940cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59458/0 (socket says 172.21.15.169:59458) 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f60937fe640 1 -- 172.21.15.169:0/1668120339 learned_addr learned my addr 172.21.15.169:0/1668120339 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6093fff640 1 --2- 172.21.15.169:0/1668120339 >> v2:172.21.15.26:3300/0 conn(0x7f609415b7b0 0x7f609415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6092ffd640 1 -- 172.21.15.169:0/1668120339 >> v2:172.21.15.26:3300/0 conn(0x7f609415b7b0 msgr2=0x7f609415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6092ffd640 1 --2- 172.21.15.169:0/1668120339 >> v2:172.21.15.26:3300/0 conn(0x7f609415b7b0 0x7f609415bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6092ffd640 1 -- 172.21.15.169:0/1668120339 >> v1:172.21.15.169:6789/0 conn(0x7f60940cd4f0 legacy=0x7f60940c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6092ffd640 1 -- 172.21.15.169:0/1668120339 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609415c120 con 0x7f6094072c60 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.290+0000 7f6093fff640 1 --2- 172.21.15.169:0/1668120339 >> v2:172.21.15.26:3300/0 conn(0x7f609415b7b0 0x7f609415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.291+0000 7f6092ffd640 1 --2- 172.21.15.169:0/1668120339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6094072c60 0x7f60940cd8d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60940cb090 tx=0x7f607c02c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2b9566bc0f5189 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.291+0000 7f60927fc640 1 -- 172.21.15.169:0/1668120339 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c036020 con 0x7f6094072c60 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.291+0000 7f60927fc640 1 -- 172.21.15.169:0/1668120339 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c032800 con 0x7f6094072c60 2024-04-25T13:15:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.291+0000 7f60927fc640 1 -- 172.21.15.169:0/1668120339 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c032bd0 con 0x7f6094072c60 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 -- 172.21.15.169:0/1668120339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6094072c60 msgr2=0x7f60940cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 --2- 172.21.15.169:0/1668120339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6094072c60 0x7f60940cd8d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60940cb090 tx=0x7f607c02c900 comp rx=0 tx=0).stop 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 -- 172.21.15.169:0/1668120339 shutdown_connections 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 --2- 172.21.15.169:0/1668120339 >> v2:172.21.15.26:3300/0 conn(0x7f609415b7b0 0x7f609415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 --2- 172.21.15.169:0/1668120339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6094072c60 0x7f60940cd8d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 -- 172.21.15.169:0/1668120339 >> 172.21.15.169:0/1668120339 conn(0x7f609406b920 msgr2=0x7f609406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 -- 172.21.15.169:0/1668120339 shutdown_connections 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.292+0000 7f6099d4b640 1 -- 172.21.15.169:0/1668120339 wait complete. 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.293+0000 7f6099d4b640 1 Processor -- start 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.293+0000 7f6099d4b640 1 -- start start 2024-04-25T13:15:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6099d4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6094072c60 0x7f60941f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6099d4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60940cd4f0 0x7f6094157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6099d4b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609415b7b0 0x7f6094158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6099d4b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6094158b10 con 0x7f6094072c60 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6099d4b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6094158830 con 0x7f60940cd4f0 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6099d4b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f60940c8f90 con 0x7f609415b7b0 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60940cd4f0 0x7f6094157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60940cd4f0 0x7f6094157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59468/0 (socket says 172.21.15.169:59468) 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 -- 172.21.15.169:0/3075532538 learned_addr learned my addr 172.21.15.169:0/3075532538 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6093fff640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609415b7b0 0x7f6094158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f60937fe640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6094072c60 0x7f60941f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 -- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609415b7b0 msgr2=0x7f6094158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609415b7b0 0x7f6094158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 -- 172.21.15.169:0/3075532538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6094072c60 msgr2=0x7f60941f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6094072c60 0x7f60941f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6092ffd640 1 -- 172.21.15.169:0/3075532538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6094155e80 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.294+0000 7f6093fff640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609415b7b0 0x7f6094158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f6092ffd640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60940cd4f0 0x7f6094157940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f607c035040 tx=0x7f607c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f608bfff640 1 -- 172.21.15.169:0/3075532538 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c036040 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f608bfff640 1 -- 172.21.15.169:0/3075532538 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c031c10 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f608bfff640 1 -- 172.21.15.169:0/3075532538 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c044480 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6094156420 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60941f1880 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f608bfff640 1 -- 172.21.15.169:0/3075532538 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f607c039020 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.295+0000 7f608bfff640 1 -- 172.21.15.169:0/3075532538 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f607c03bc20 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.296+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60940ce420 con 0x7f60940cd4f0 2024-04-25T13:15:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.299+0000 7f608bfff640 1 -- 172.21.15.169:0/3075532538 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f60940ce420 con 0x7f60940cd4f0 2024-04-25T13:15:46.347 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:46.346+0000 7fcdbaa12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:15:46.366 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:46.366+0000 7f84767be040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:15:46.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.370+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "173f6a99-2092-4c24-b834-e80e4b940259", "id": 3} v 0) -- 0x7f6094067d20 con 0x7f60940cd4f0 2024-04-25T13:15:46.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.373+0000 7f608bfff640 1 -- 172.21.15.169:0/3075532538 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "173f6a99-2092-4c24-b834-e80e4b940259", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f607c052080 con 0x7f60940cd4f0 2024-04-25T13:15:46.374 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-04-25T13:15:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60940cd4f0 msgr2=0x7f6094157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60940cd4f0 0x7f6094157940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f607c035040 tx=0x7f607c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 shutdown_connections 2024-04-25T13:15:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609415b7b0 0x7f6094158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60940cd4f0 0x7f6094157940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 --2- 172.21.15.169:0/3075532538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6094072c60 0x7f60941f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 >> 172.21.15.169:0/3075532538 conn(0x7f609406b920 msgr2=0x7f60940cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 shutdown_connections 2024-04-25T13:15:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.374+0000 7f6099d4b640 1 -- 172.21.15.169:0/3075532538 wait complete. 2024-04-25T13:15:46.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 7bb418fc-87cf-4c4a-b5ff-e895195310bf 4 2024-04-25T13:15:46.414 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:46.414+0000 7f84767be040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:15:46.440 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:46.439+0000 7fcdbaa12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:46.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.483+0000 7f8b02059640 1 Processor -- start 2024-04-25T13:15:46.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.483+0000 7f8b02059640 1 -- start start 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8b02059640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc06c880 0x7f8afc06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8b02059640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc06d200 con 0x7f8afc0c7c20 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8b02059640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc15eaa0 con 0x7f8afc155710 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8b02059640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8afc0c8940 con 0x7f8afc06c880 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8afaffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc06c880 0x7f8afc06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8afb7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f8afc155710 0x7f8afc0cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:37460/0 (socket says 172.21.15.169:37460) 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8afb7fe640 1 -- 172.21.15.169:0/4111656659 learned_addr learned my addr 172.21.15.169:0/4111656659 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-25T13:15:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8afaffd640 1 -- 172.21.15.169:0/4111656659 >> v1:172.21.15.169:6789/0 conn(0x7f8afc155710 legacy=0x7f8afc0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8afaffd640 1 -- 172.21.15.169:0/4111656659 >> v1:172.21.15.26:6789/0 conn(0x7f8afc0c7c20 legacy=0x7f8afc0c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8afa7fc640 1 -- 172.21.15.169:0/4111656659 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628539474 0 0) 0x7f8afc15eaa0 con 0x7f8afc155710 2024-04-25T13:15:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.484+0000 7f8afaffd640 1 -- 172.21.15.169:0/4111656659 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc15ed80 con 0x7f8afc06c880 2024-04-25T13:15:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.485+0000 7f8afaffd640 1 --2- 172.21.15.169:0/4111656659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc06c880 0x7f8afc06ccc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0097d0 tx=0x7f8aec02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bddd47a51dadb9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.486 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:46.485+0000 7fcdbaa12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.485+0000 7f8afa7fc640 1 -- 172.21.15.169:0/4111656659 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec037070 con 0x7f8afc06c880 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.485+0000 7f8afa7fc640 1 -- 172.21.15.169:0/4111656659 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec032440 con 0x7f8afc06c880 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.485+0000 7f8afa7fc640 1 -- 172.21.15.169:0/4111656659 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec032810 con 0x7f8afc06c880 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.486+0000 7f8b02059640 1 -- 172.21.15.169:0/4111656659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc06c880 msgr2=0x7f8afc06ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.486+0000 7f8b02059640 1 --2- 172.21.15.169:0/4111656659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc06c880 0x7f8afc06ccc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0097d0 tx=0x7f8aec02a210 comp rx=0 tx=0).stop 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.486+0000 7f8b02059640 1 -- 172.21.15.169:0/4111656659 shutdown_connections 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.486+0000 7f8b02059640 1 --2- 172.21.15.169:0/4111656659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc06c880 0x7f8afc06ccc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.486+0000 7f8b02059640 1 -- 172.21.15.169:0/4111656659 >> 172.21.15.169:0/4111656659 conn(0x7f8afc0731d0 msgr2=0x7f8afc0735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.486+0000 7f8b02059640 1 -- 172.21.15.169:0/4111656659 shutdown_connections 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.486+0000 7f8b02059640 1 -- 172.21.15.169:0/4111656659 wait complete. 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.487+0000 7f8b02059640 1 Processor -- start 2024-04-25T13:15:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.487+0000 7f8b02059640 1 -- start start 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8b02059640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8afc06c880 0x7f8afc150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8b02059640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8afc0c7c20 0x7f8afc0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8b02059640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc155710 0x7f8afc1f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8b02059640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc15f6b0 con 0x7f8afc0c7c20 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8b02059640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc155af0 con 0x7f8afc06c880 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8b02059640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8afc15f340 con 0x7f8afc155710 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8afc06c880 0x7f8afc150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8afc06c880 0x7f8afc150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59478/0 (socket says 172.21.15.169:59478) 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afb7fe640 1 -- 172.21.15.169:0/2449509195 learned_addr learned my addr 172.21.15.169:0/2449509195 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afbfff640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc155710 0x7f8afc1f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afaffd640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8afc0c7c20 0x7f8afc0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afbfff640 1 -- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8afc06c880 msgr2=0x7f8afc150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afbfff640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8afc06c880 0x7f8afc150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afbfff640 1 -- 172.21.15.169:0/2449509195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8afc0c7c20 msgr2=0x7f8afc0c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afbfff640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8afc0c7c20 0x7f8afc0c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afbfff640 1 -- 172.21.15.169:0/2449509195 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc157420 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afb7fe640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8afc06c880 0x7f8afc150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8afbfff640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc155710 0x7f8afc1f4170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c6c0 tx=0x7f8af400cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.488+0000 7f8af3fff640 1 -- 172.21.15.169:0/2449509195 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4003b70 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.489+0000 7f8af3fff640 1 -- 172.21.15.169:0/2449509195 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af4003d10 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.489+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc158a70 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.489+0000 7f8af3fff640 1 -- 172.21.15.169:0/2449509195 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af40052f0 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.489+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc14dee0 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.489+0000 7f8af3fff640 1 -- 172.21.15.169:0/2449509195 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8af4005490 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.489+0000 7f8af3fff640 1 -- 172.21.15.169:0/2449509195 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8af4012980 con 0x7f8afc155710 2024-04-25T13:15:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.490+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc068f50 con 0x7f8afc155710 2024-04-25T13:15:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.492+0000 7f8af3fff640 1 -- 172.21.15.169:0/2449509195 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8af4012c60 con 0x7f8afc155710 2024-04-25T13:15:46.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.565+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7bb418fc-87cf-4c4a-b5ff-e895195310bf", "id": 4} v 0) -- 0x7f8afc0c9f60 con 0x7f8afc155710 2024-04-25T13:15:46.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.568+0000 7f8af3fff640 1 -- 172.21.15.169:0/2449509195 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bb418fc-87cf-4c4a-b5ff-e895195310bf", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8af4012470 con 0x7f8afc155710 2024-04-25T13:15:46.569 INFO:teuthology.orchestra.run.smithi169.stdout:4 2024-04-25T13:15:46.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc155710 msgr2=0x7f8afc1f4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc155710 0x7f8afc1f4170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c6c0 tx=0x7f8af400cb80 comp rx=0 tx=0).stop 2024-04-25T13:15:46.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 shutdown_connections 2024-04-25T13:15:46.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8afc155710 0x7f8afc1f4170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8afc0c7c20 0x7f8afc0c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 --2- 172.21.15.169:0/2449509195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8afc06c880 0x7f8afc150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 >> 172.21.15.169:0/2449509195 conn(0x7f8afc0731d0 msgr2=0x7f8afc0c8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 shutdown_connections 2024-04-25T13:15:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.569+0000 7f8b02059640 1 -- 172.21.15.169:0/2449509195 wait complete. 2024-04-25T13:15:46.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 4ba42700-03b4-40d2-9edb-59b85f4b8527 5 2024-04-25T13:15:46.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.677+0000 7f7a69c89640 1 Processor -- start 2024-04-25T13:15:46.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.677+0000 7f7a69c89640 1 -- start start 2024-04-25T13:15:46.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a69c89640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7a640cd740 0x7f7a640c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a69c89640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a640ca4c0 0x7f7a640733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a69c89640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6415c2a0 con 0x7f7a64152280 2024-04-25T13:15:46.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a69c89640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7a640c8530 con 0x7f7a640ca4c0 2024-04-25T13:15:46.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a69c89640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7a640cdea0 con 0x7f7a640cd740 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a62ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7a640cd740 0x7f7a640c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a62ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7a640cd740 0x7f7a640c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59490/0 (socket says 172.21.15.169:59490) 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a62ffd640 1 -- 172.21.15.169:0/3067792455 learned_addr learned my addr 172.21.15.169:0/3067792455 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a63fff640 1 --2- 172.21.15.169:0/3067792455 >> v2:172.21.15.26:3300/0 conn(0x7f7a640ca4c0 0x7f7a640733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a62ffd640 1 -- 172.21.15.169:0/3067792455 >> v2:172.21.15.26:3300/0 conn(0x7f7a640ca4c0 msgr2=0x7f7a640733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a62ffd640 1 --2- 172.21.15.169:0/3067792455 >> v2:172.21.15.26:3300/0 conn(0x7f7a640ca4c0 0x7f7a640733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a62ffd640 1 -- 172.21.15.169:0/3067792455 >> v1:172.21.15.26:6789/0 conn(0x7f7a64152280 legacy=0x7f7a640724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.678+0000 7f7a62ffd640 1 -- 172.21.15.169:0/3067792455 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6415b4e0 con 0x7f7a640cd740 2024-04-25T13:15:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.679+0000 7f7a62ffd640 1 --2- 172.21.15.169:0/3067792455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a640cd740 0x7f7a640c9f80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7a64158ec0 tx=0x7f7a4c02c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a9b12bb8b93031 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.679+0000 7f7a627fc640 1 -- 172.21.15.169:0/3067792455 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c035070 con 0x7f7a640cd740 2024-04-25T13:15:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.679+0000 7f7a627fc640 1 -- 172.21.15.169:0/3067792455 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c031830 con 0x7f7a640cd740 2024-04-25T13:15:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.679+0000 7f7a627fc640 1 -- 172.21.15.169:0/3067792455 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c031c00 con 0x7f7a640cd740 2024-04-25T13:15:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 -- 172.21.15.169:0/3067792455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a640cd740 msgr2=0x7f7a640c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 --2- 172.21.15.169:0/3067792455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a640cd740 0x7f7a640c9f80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7a64158ec0 tx=0x7f7a4c02c9d0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 -- 172.21.15.169:0/3067792455 shutdown_connections 2024-04-25T13:15:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 --2- 172.21.15.169:0/3067792455 >> v2:172.21.15.26:3300/0 conn(0x7f7a640ca4c0 0x7f7a640733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 --2- 172.21.15.169:0/3067792455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a640cd740 0x7f7a640c9f80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 -- 172.21.15.169:0/3067792455 >> 172.21.15.169:0/3067792455 conn(0x7f7a6406e1a0 msgr2=0x7f7a6406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 -- 172.21.15.169:0/3067792455 shutdown_connections 2024-04-25T13:15:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.680+0000 7f7a69c89640 1 -- 172.21.15.169:0/3067792455 wait complete. 2024-04-25T13:15:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.681+0000 7f7a69c89640 1 Processor -- start 2024-04-25T13:15:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.681+0000 7f7a69c89640 1 -- start start 2024-04-25T13:15:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a69c89640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a640ca4c0 0x7f7a64149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a69c89640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a640cd740 0x7f7a64149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a69c89640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a64152280 0x7f7a64148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a69c89640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6415bd80 con 0x7f7a640cd740 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a69c89640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6415baa0 con 0x7f7a64152280 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a69c89640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7a640cdb90 con 0x7f7a640ca4c0 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a637fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a640ca4c0 0x7f7a64149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a64152280 0x7f7a64148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a64152280 0x7f7a64148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59496/0 (socket says 172.21.15.169:59496) 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a637fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a640ca4c0 0x7f7a64149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:53866/0 (socket says 172.21.15.169:53866) 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 -- 172.21.15.169:0/2304631169 learned_addr learned my addr 172.21.15.169:0/2304631169 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a62ffd640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a640cd740 0x7f7a64149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 -- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a640ca4c0 msgr2=0x7f7a64149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a640ca4c0 0x7f7a64149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 -- 172.21.15.169:0/2304631169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a640cd740 msgr2=0x7f7a64149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a640cd740 0x7f7a64149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 -- 172.21.15.169:0/2304631169 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a641491f0 con 0x7f7a64152280 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a637fe640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a640ca4c0 0x7f7a64149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.682+0000 7f7a63fff640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a64152280 0x7f7a64148430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c007e40 tx=0x7f7a5c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.683+0000 7f7a5bfff640 1 -- 172.21.15.169:0/2304631169 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c014620 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.683+0000 7f7a5bfff640 1 -- 172.21.15.169:0/2304631169 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c019070 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.683+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a641edad0 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.683+0000 7f7a5bfff640 1 -- 172.21.15.169:0/2304631169 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c014a20 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.683+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a641f0510 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.683+0000 7f7a5bfff640 1 -- 172.21.15.169:0/2304631169 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7a5c014bc0 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.683+0000 7f7a5bfff640 1 -- 172.21.15.169:0/2304631169 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7a5c01d940 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.684+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6404fe00 con 0x7f7a64152280 2024-04-25T13:15:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.686+0000 7f7a5bfff640 1 -- 172.21.15.169:0/2304631169 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7a6404fe00 con 0x7f7a64152280 2024-04-25T13:15:46.687 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:46.687+0000 7fcdbaa12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:15:46.738 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:46.738+0000 7fcdbaa12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:15:46.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.757+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4ba42700-03b4-40d2-9edb-59b85f4b8527", "id": 5} v 0) -- 0x7f7a64068f50 con 0x7f7a64152280 2024-04-25T13:15:46.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.760+0000 7f7a5bfff640 1 -- 172.21.15.169:0/2304631169 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ba42700-03b4-40d2-9edb-59b85f4b8527", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7a5c01dc10 con 0x7f7a64152280 2024-04-25T13:15:46.761 INFO:teuthology.orchestra.run.smithi169.stdout:5 2024-04-25T13:15:46.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a64152280 msgr2=0x7f7a64148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a64152280 0x7f7a64148430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c007e40 tx=0x7f7a5c00e4b0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 shutdown_connections 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a64152280 0x7f7a64148430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a640cd740 0x7f7a64149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 --2- 172.21.15.169:0/2304631169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a640ca4c0 0x7f7a64149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 >> 172.21.15.169:0/2304631169 conn(0x7f7a6406e1a0 msgr2=0x7f7a6414dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 shutdown_connections 2024-04-25T13:15:46.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.761+0000 7f7a69c89640 1 -- 172.21.15.169:0/2304631169 wait complete. 2024-04-25T13:15:46.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 26397687-3ed9-407d-81db-eb9765059969 6 2024-04-25T13:15:46.795 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:46.794+0000 7fcdbaa12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:15:46.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.869+0000 7ff3357bf640 1 Processor -- start 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.869+0000 7ff3357bf640 1 -- start start 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.869+0000 7ff3357bf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3301553c0 0x7ff33015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.869+0000 7ff3357bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3300cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.869+0000 7ff3357bf640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3300c5c80 con 0x7ff33015b070 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.869+0000 7ff3357bf640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff33015e660 con 0x7ff3301553c0 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.869+0000 7ff3357bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3301557a0 con 0x7ff33015f310 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3300cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3300cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:53882/0 (socket says 172.21.15.169:53882) 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 -- 172.21.15.169:0/2716121524 learned_addr learned my addr 172.21.15.169:0/2716121524 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32effd640 1 --2- 172.21.15.169:0/2716121524 >> v2:172.21.15.26:3300/0 conn(0x7ff3301553c0 0x7ff33015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 -- 172.21.15.169:0/2716121524 >> v2:172.21.15.26:3300/0 conn(0x7ff3301553c0 msgr2=0x7ff33015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:46.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 --2- 172.21.15.169:0/2716121524 >> v2:172.21.15.26:3300/0 conn(0x7ff3301553c0 0x7ff33015edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 -- 172.21.15.169:0/2716121524 >> v1:172.21.15.26:6789/0 conn(0x7ff33015b070 legacy=0x7ff3300d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 -- 172.21.15.169:0/2716121524 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33015b5d0 con 0x7ff33015f310 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.870+0000 7ff32e7fc640 1 --2- 172.21.15.169:0/2716121524 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3300cb5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff320009850 tx=0x7ff32002a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3cbe77f50aad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff32dffb640 1 -- 172.21.15.169:0/2716121524 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320004030 con 0x7ff33015f310 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff32dffb640 1 -- 172.21.15.169:0/2716121524 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200041d0 con 0x7ff33015f310 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff32dffb640 1 -- 172.21.15.169:0/2716121524 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320003610 con 0x7ff33015f310 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 -- 172.21.15.169:0/2716121524 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 msgr2=0x7ff3300cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 --2- 172.21.15.169:0/2716121524 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3300cb5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff320009850 tx=0x7ff32002a1e0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 -- 172.21.15.169:0/2716121524 shutdown_connections 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 --2- 172.21.15.169:0/2716121524 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3300cb5a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 --2- 172.21.15.169:0/2716121524 >> v2:172.21.15.26:3300/0 conn(0x7ff3301553c0 0x7ff33015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 -- 172.21.15.169:0/2716121524 >> 172.21.15.169:0/2716121524 conn(0x7ff330072360 msgr2=0x7ff330074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 -- 172.21.15.169:0/2716121524 shutdown_connections 2024-04-25T13:15:46.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.871+0000 7ff3357bf640 1 -- 172.21.15.169:0/2716121524 wait complete. 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 Processor -- start 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 -- start start 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3301553c0 0x7ff3301e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33015b070 0x7ff3301f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3301f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff33015be70 con 0x7ff3301553c0 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff33015bb90 con 0x7ff33015b070 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff3357bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff33015e8b0 con 0x7ff33015f310 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3301f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff32e7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33015b070 0x7ff3301f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3301f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:53894/0 (socket says 172.21.15.169:53894) 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.873+0000 7ff32f7fe640 1 -- 172.21.15.169:0/4286524919 learned_addr learned my addr 172.21.15.169:0/4286524919 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:46.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32effd640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3301553c0 0x7ff3301e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32f7fe640 1 -- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33015b070 msgr2=0x7ff3301f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32f7fe640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33015b070 0x7ff3301f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32f7fe640 1 -- 172.21.15.169:0/4286524919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3301553c0 msgr2=0x7ff3301e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32f7fe640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3301553c0 0x7ff3301e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32f7fe640 1 -- 172.21.15.169:0/4286524919 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33015e3f0 con 0x7ff33015f310 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32e7fc640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33015b070 0x7ff3301f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff32f7fe640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3301f4b40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c780 tx=0x7ff32800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff3177fe640 1 -- 172.21.15.169:0/4286524919 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328017070 con 0x7ff33015f310 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff3177fe640 1 -- 172.21.15.169:0/4286524919 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff328003da0 con 0x7ff33015f310 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3300ce8c0 con 0x7ff33015f310 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff3177fe640 1 -- 172.21.15.169:0/4286524919 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280052b0 con 0x7ff33015f310 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff330153aa0 con 0x7ff33015f310 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff3177fe640 1 -- 172.21.15.169:0/4286524919 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff32801a070 con 0x7ff33015f310 2024-04-25T13:15:46.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.874+0000 7ff3177fe640 1 -- 172.21.15.169:0/4286524919 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7ff32800ad10 con 0x7ff33015f310 2024-04-25T13:15:46.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.875+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff330068f50 con 0x7ff33015f310 2024-04-25T13:15:46.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.877+0000 7ff3177fe640 1 -- 172.21.15.169:0/4286524919 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff328021020 con 0x7ff33015f310 2024-04-25T13:15:46.914 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:46.914+0000 7fcdbaa12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:46.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.951+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "26397687-3ed9-407d-81db-eb9765059969", "id": 6} v 0) -- 0x7ff3301542d0 con 0x7ff33015f310 2024-04-25T13:15:46.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3177fe640 1 -- 172.21.15.169:0/4286524919 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26397687-3ed9-407d-81db-eb9765059969", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7ff33015e3f0 con 0x7ff33015f310 2024-04-25T13:15:46.954 INFO:teuthology.orchestra.run.smithi169.stdout:6 2024-04-25T13:15:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 msgr2=0x7ff3301f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3357bf640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3301f4b40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c780 tx=0x7ff32800cc40 comp rx=0 tx=0).stop 2024-04-25T13:15:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 shutdown_connections 2024-04-25T13:15:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3357bf640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33015f310 0x7ff3301f4b40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3357bf640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33015b070 0x7ff3301f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3357bf640 1 --2- 172.21.15.169:0/4286524919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3301553c0 0x7ff3301e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.954+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 >> 172.21.15.169:0/4286524919 conn(0x7ff330072360 msgr2=0x7ff3300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.955+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 shutdown_connections 2024-04-25T13:15:46.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:46.955+0000 7ff3357bf640 1 -- 172.21.15.169:0/4286524919 wait complete. 2024-04-25T13:15:46.966 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 872b5be9-f7e4-48ea-951d-fc41de585647 7 2024-04-25T13:15:47.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.103+0000 7f39b402c640 1 Processor -- start 2024-04-25T13:15:47.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.103+0000 7f39b402c640 1 -- start start 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b402c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39ac0ca260 0x7f39ac159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b402c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac0ca640 0x7f39ac15c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b402c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39ac15cf10 0x7f39ac0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b402c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f39ac0c7a40 con 0x7f39ac15cf10 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b402c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f39ac0c4da0 con 0x7f39ac0ca260 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b402c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac0c5080 con 0x7f39ac0ca640 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b15c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac0ca640 0x7f39ac15c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b1dc8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39ac0ca260 0x7f39ac159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b15c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac0ca640 0x7f39ac15c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:53908/0 (socket says 172.21.15.169:53908) 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b1dc8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39ac0ca260 0x7f39ac159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59504/0 (socket says 172.21.15.169:59504) 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b15c7640 1 -- 172.21.15.169:0/2374665762 learned_addr learned my addr 172.21.15.169:0/2374665762 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b25c9640 1 --2- 172.21.15.169:0/2374665762 >> v2:172.21.15.26:3300/0 conn(0x7f39ac15cf10 0x7f39ac0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b1dc8640 1 -- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac0ca640 msgr2=0x7f39ac15c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b1dc8640 1 --2- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac0ca640 0x7f39ac15c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b1dc8640 1 -- 172.21.15.169:0/2374665762 >> v2:172.21.15.26:3300/0 conn(0x7f39ac15cf10 msgr2=0x7f39ac0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b1dc8640 1 --2- 172.21.15.169:0/2374665762 >> v2:172.21.15.26:3300/0 conn(0x7f39ac15cf10 0x7f39ac0cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b1dc8640 1 -- 172.21.15.169:0/2374665762 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac0c5360 con 0x7f39ac0ca260 2024-04-25T13:15:47.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.104+0000 7f39b15c7640 1 --2- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac0ca640 0x7f39ac15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:47.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.105+0000 7f39b1dc8640 1 --2- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca260 0x7f39ac159690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39ac075e00 tx=0x7f39a802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcd85160c82ef7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:47.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.105+0000 7f39b0dc6640 1 -- 172.21.15.169:0/2374665762 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8037070 con 0x7f39ac0ca260 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.105+0000 7f39b0dc6640 1 -- 172.21.15.169:0/2374665762 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a8032440 con 0x7f39ac0ca260 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.105+0000 7f39b0dc6640 1 -- 172.21.15.169:0/2374665762 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8032810 con 0x7f39ac0ca260 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.105+0000 7f39b402c640 1 -- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca260 msgr2=0x7f39ac159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.105+0000 7f39b402c640 1 --2- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca260 0x7f39ac159690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39ac075e00 tx=0x7f39a802a1a0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.106+0000 7f39b402c640 1 -- 172.21.15.169:0/2374665762 shutdown_connections 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.106+0000 7f39b402c640 1 --2- 172.21.15.169:0/2374665762 >> v2:172.21.15.26:3300/0 conn(0x7f39ac15cf10 0x7f39ac0cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.106+0000 7f39b402c640 1 --2- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac0ca640 0x7f39ac15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.106+0000 7f39b402c640 1 --2- 172.21.15.169:0/2374665762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca260 0x7f39ac159690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.106+0000 7f39b402c640 1 -- 172.21.15.169:0/2374665762 >> 172.21.15.169:0/2374665762 conn(0x7f39ac06b920 msgr2=0x7f39ac06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.106+0000 7f39b402c640 1 -- 172.21.15.169:0/2374665762 shutdown_connections 2024-04-25T13:15:47.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.106+0000 7f39b402c640 1 -- 172.21.15.169:0/2374665762 wait complete. 2024-04-25T13:15:47.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.107+0000 7f39b402c640 1 Processor -- start 2024-04-25T13:15:47.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.107+0000 7f39b402c640 1 -- start start 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac0ca260 0x7f39ac0ba6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca640 0x7f39ac156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac15cf10 0x7f39ac1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac15d360 con 0x7f39ac0ca260 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac159170 con 0x7f39ac0ca640 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac158e60 con 0x7f39ac15cf10 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca640 0x7f39ac156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b25c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac15cf10 0x7f39ac1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca640 0x7f39ac156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59506/0 (socket says 172.21.15.169:59506) 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 -- 172.21.15.169:0/3581771144 learned_addr learned my addr 172.21.15.169:0/3581771144 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b1dc8640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac0ca260 0x7f39ac0ba6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 -- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac15cf10 msgr2=0x7f39ac1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac15cf10 0x7f39ac1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 -- 172.21.15.169:0/3581771144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac0ca260 msgr2=0x7f39ac0ba6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac0ca260 0x7f39ac0ba6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 -- 172.21.15.169:0/3581771144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac157b10 con 0x7f39ac0ca640 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b25c9640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac15cf10 0x7f39ac1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b15c7640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca640 0x7f39ac156650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f399c006e00 tx=0x7f399c00ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39a27fc640 1 -- 172.21.15.169:0/3581771144 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c00ca00 con 0x7f39ac0ca640 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39a27fc640 1 -- 172.21.15.169:0/3581771144 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c00cba0 con 0x7f39ac0ca640 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39a27fc640 1 -- 172.21.15.169:0/3581771144 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c004030 con 0x7f39ac0ca640 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ac0bac10 con 0x7f39ac0ca640 2024-04-25T13:15:47.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.109+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ac1e30a0 con 0x7f39ac0ca640 2024-04-25T13:15:47.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.110+0000 7f39a27fc640 1 -- 172.21.15.169:0/3581771144 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f399c005990 con 0x7f39ac0ca640 2024-04-25T13:15:47.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.110+0000 7f39a27fc640 1 -- 172.21.15.169:0/3581771144 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f399c003c50 con 0x7f39ac0ca640 2024-04-25T13:15:47.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.110+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ac068f50 con 0x7f39ac0ca640 2024-04-25T13:15:47.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.112+0000 7f39a27fc640 1 -- 172.21.15.169:0/3581771144 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f399c017020 con 0x7f39ac0ca640 2024-04-25T13:15:47.143 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:47.144+0000 7f84767be040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:15:47.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.185+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "872b5be9-f7e4-48ea-951d-fc41de585647", "id": 7} v 0) -- 0x7f39ac1532d0 con 0x7f39ac0ca640 2024-04-25T13:15:47.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.191+0000 7f39a27fc640 1 -- 172.21.15.169:0/3581771144 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "872b5be9-f7e4-48ea-951d-fc41de585647", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f399c005c80 con 0x7f39ac0ca640 2024-04-25T13:15:47.192 INFO:teuthology.orchestra.run.smithi169.stdout:7 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca640 msgr2=0x7f39ac156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca640 0x7f39ac156650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f399c006e00 tx=0x7f399c00ee10 comp rx=0 tx=0).stop 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 shutdown_connections 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39ac15cf10 0x7f39ac1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39ac0ca640 0x7f39ac156650 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 --2- 172.21.15.169:0/3581771144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac0ca260 0x7f39ac0ba6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 >> 172.21.15.169:0/3581771144 conn(0x7f39ac06b920 msgr2=0x7f39ac0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 shutdown_connections 2024-04-25T13:15:47.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-25T13:15:47.192+0000 7f39b402c640 1 -- 172.21.15.169:0/3581771144 wait complete. 2024-04-25T13:15:47.203 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T13:15:47.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T13:15:47.205 INFO:tasks.ceph.osd.0:Started 2024-04-25T13:15:47.205 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T13:15:47.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T13:15:47.209 INFO:tasks.ceph.osd.1:Started 2024-04-25T13:15:47.209 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T13:15:47.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T13:15:47.211 INFO:tasks.ceph.osd.2:Started 2024-04-25T13:15:47.211 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T13:15:47.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T13:15:47.213 INFO:tasks.ceph.osd.3:Started 2024-04-25T13:15:47.214 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T13:15:47.214 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T13:15:47.216 INFO:tasks.ceph.osd.4:Started 2024-04-25T13:15:47.216 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T13:15:47.216 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T13:15:47.218 INFO:tasks.ceph.osd.5:Started 2024-04-25T13:15:47.218 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T13:15:47.218 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T13:15:47.220 INFO:tasks.ceph.osd.6:Started 2024-04-25T13:15:47.220 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T13:15:47.220 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T13:15:47.222 INFO:tasks.ceph.osd.7:Started 2024-04-25T13:15:47.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:15:47.250 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:47.250+0000 7f84767be040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:47.325 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:47.325+0000 7f84767be040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:15:47.332 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:47.332+0000 7fcdbaa12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:15:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.334+0000 7fbe27fa2640 1 Processor -- start 2024-04-25T13:15:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.334+0000 7fbe27fa2640 1 -- start start 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe27fa2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200b3c00 0x7fbe200b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe27fa2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe200b5450 0x7fbe200d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe27fa2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe201558c0 con 0x7fbe201554e0 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe27fa2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbe200b4a80 con 0x7fbe200b5450 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe27fa2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200cb8c0 con 0x7fbe200b3c00 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe25d3e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbe201554e0 0x7fbe2015f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46204/0 (socket says 172.21.15.26:46204) 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe25d3e640 1 -- 172.21.15.26:0/3235471865 learned_addr learned my addr 172.21.15.26:0/3235471865 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe2653f640 1 --2- 172.21.15.26:0/3235471865 >> v2:172.21.15.169:3300/0 conn(0x7fbe200b5450 0x7fbe200d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe2553d640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200b3c00 0x7fbe200b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871200186 0 0) 0x7fbe1c001110 con 0x7fbe201554e0 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe0c003520 con 0x7fbe201554e0 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 66787617 0 0) 0x7fbe0c003520 con 0x7fbe201554e0 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200b3c00 msgr2=0x7fbe200b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:47.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200b3c00 0x7fbe200b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 >> v2:172.21.15.169:3300/0 conn(0x7fbe200b5450 msgr2=0x7fbe200d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 --2- 172.21.15.26:0/3235471865 >> v2:172.21.15.169:3300/0 conn(0x7fbe200b5450 0x7fbe200d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200cbba0 con 0x7fbe201554e0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7fbe1c001840 con 0x7fbe201554e0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.335+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 >> v1:172.21.15.26:6789/0 conn(0x7fbe201554e0 legacy=0x7fbe2015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe24d3c640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe0c0039b0 0x7fbe0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe24d3c640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c0043a0 0x7fbe0c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe24d3c640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe0c004ef0 0x7fbe0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200b4a80 con 0x7fbe0c004ef0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200cb8c0 con 0x7fbe0c0043a0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c00bf00 con 0x7fbe0c0039b0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe2653f640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe0c004ef0 0x7fbe0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe25d3e640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe0c0039b0 0x7fbe0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe2553d640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c0043a0 0x7fbe0c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe2653f640 1 -- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe0c0039b0 msgr2=0x7fbe0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe2653f640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe0c0039b0 0x7fbe0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe2653f640 1 -- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c0043a0 msgr2=0x7fbe0c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe2653f640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c0043a0 0x7fbe0c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.336+0000 7fbe2653f640 1 -- 172.21.15.26:0/3235471865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200cbba0 con 0x7fbe0c004ef0 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe2653f640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe0c004ef0 0x7fbe0c00b9c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009fc0 tx=0x7fbe0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a106305e368cc788 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18009c10 con 0x7fbe0c004ef0 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe18036070 con 0x7fbe0c004ef0 2024-04-25T13:15:47.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe24d3c640 1 -- 172.21.15.26:0/3235471865 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18009c10 con 0x7fbe0c004ef0 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe27fa2640 1 -- 172.21.15.26:0/3235471865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe0c004ef0 msgr2=0x7fbe0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe27fa2640 1 --2- 172.21.15.26:0/3235471865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe0c004ef0 0x7fbe0c00b9c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009fc0 tx=0x7fbe0c005830 comp rx=0 tx=0).stop 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe2653f640 1 -- 172.21.15.26:0/3235471865 reap_dead start 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe27fa2640 1 -- 172.21.15.26:0/3235471865 shutdown_connections 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.337+0000 7fbe27fa2640 1 -- 172.21.15.26:0/3235471865 >> 172.21.15.26:0/3235471865 conn(0x7fbe20074d50 msgr2=0x7fbe20075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.338+0000 7fbe27fa2640 1 -- 172.21.15.26:0/3235471865 shutdown_connections 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.338+0000 7fbe27fa2640 1 -- 172.21.15.26:0/3235471865 wait complete. 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 Processor -- start 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 -- start start 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c004ef0 0x7fbe201e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe201f2230 0x7fbe200c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200c7210 0x7fbe20150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200b4710 con 0x7fbe201f2230 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200b4430 con 0x7fbe0c004ef0 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.339+0000 7fbe27fa2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200b3580 con 0x7fbe200c7210 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe201f2230 0x7fbe200c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe25d3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c004ef0 0x7fbe201e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe201f2230 0x7fbe200c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40370/0 (socket says 172.21.15.26:40370) 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe25d3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c004ef0 0x7fbe201e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:52104/0 (socket says 172.21.15.26:52104) 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 -- 172.21.15.26:0/1379859630 learned_addr learned my addr 172.21.15.26:0/1379859630 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2653f640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200c7210 0x7fbe20150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 -- 172.21.15.26:0/1379859630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200c7210 msgr2=0x7fbe20150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200c7210 0x7fbe20150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 -- 172.21.15.26:0/1379859630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c004ef0 msgr2=0x7fbe201e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c004ef0 0x7fbe201e6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 -- 172.21.15.26:0/1379859630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe201e5710 con 0x7fbe201f2230 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe2553d640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe201f2230 0x7fbe200c6540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe10011590 tx=0x7fbe10011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:47.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe167fc640 1 -- 172.21.15.26:0/1379859630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10019070 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe167fc640 1 -- 172.21.15.26:0/1379859630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe10004440 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe201e6f90 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe167fc640 1 -- 172.21.15.26:0/1379859630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10003810 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.340+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe201e5c90 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.341+0000 7fbe167fc640 1 -- 172.21.15.26:0/1379859630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe1001c070 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.341+0000 7fbe167fc640 1 -- 172.21.15.26:0/1379859630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbe10015460 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.341+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe20068e40 con 0x7fbe201f2230 2024-04-25T13:15:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.344+0000 7fbe167fc640 1 -- 172.21.15.26:0/1379859630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbe10005990 con 0x7fbe201f2230 2024-04-25T13:15:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.406+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe200cd3e0 con 0x7fbe201f2230 2024-04-25T13:15:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.406+0000 7fbe167fc640 1 -- 172.21.15.26:0/1379859630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbe10005bd0 con 0x7fbe201f2230 2024-04-25T13:15:47.406 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:15:47.406 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:15:47.188399+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe201f2230 msgr2=0x7fbe200c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe201f2230 0x7fbe200c6540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe10011590 tx=0x7fbe10011a50 comp rx=0 tx=0).stop 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 shutdown_connections 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe200c7210 0x7fbe20150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe201f2230 0x7fbe200c6540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 --2- 172.21.15.26:0/1379859630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe0c004ef0 0x7fbe201e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 >> 172.21.15.26:0/1379859630 conn(0x7fbe20074d50 msgr2=0x7fbe201520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.407+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 shutdown_connections 2024-04-25T13:15:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:15:47.408+0000 7fbe27fa2640 1 -- 172.21.15.26:0/1379859630 wait complete. 2024-04-25T13:15:47.418 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T13:15:47.418 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T13:15:47.501 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:47.501+0000 7f84767be040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:15:47.553 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:47.553+0000 7f84767be040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:15:47.594 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:47.593+0000 7fcdbaa12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:15:47.607 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:47.608+0000 7f84767be040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:15:47.647 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:47.646+0000 7fcdbaa12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:15:47.726 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:47.726+0000 7f84767be040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:47.762 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:47.762+0000 7fcdbaa12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:15:47.814 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-25T13:15:47.813+0000 7fcf55618640 -1 Falling back to public interface 2024-04-25T13:15:47.820 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-25T13:15:47.819+0000 7f7fd3811640 -1 Falling back to public interface 2024-04-25T13:15:47.820 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-25T13:15:47.819+0000 7f1b94010640 -1 Falling back to public interface 2024-04-25T13:15:47.821 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-25T13:15:47.819+0000 7f7fd20a5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T13:15:47.821 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-25T13:15:47.819+0000 7f1b928b6640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-04-25T13:15:47.821 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-25T13:15:47.819+0000 7f1b928b6640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2024-04-25T13:15:47.835 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-25T13:15:47.833+0000 7fa2ed14c640 -1 Falling back to public interface 2024-04-25T13:15:47.838 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-25T13:15:47.837+0000 7fa916c15640 -1 Falling back to public interface 2024-04-25T13:15:47.841 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-25T13:15:47.839+0000 7f543581c640 -1 Falling back to public interface 2024-04-25T13:15:47.841 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-25T13:15:47.840+0000 7fb66f940640 -1 Falling back to public interface 2024-04-25T13:15:47.847 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-25T13:15:47.844+0000 7efe7941e640 -1 Falling back to public interface 2024-04-25T13:15:48.054 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:48.046+0000 7fcdbaa12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:15:48.094 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:48.093+0000 7fcdbaa12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:15:48.128 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:48.126+0000 7f84767be040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:15:48.225 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:15:48.251 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:48.250+0000 7fcdbaa12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:15:48.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.319+0000 7f85af842640 1 Processor -- start 2024-04-25T13:15:48.319 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.319+0000 7f85af842640 1 -- start start 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85af842640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85a8155200 0x7f85a815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85af842640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a8072310 con 0x7f85a806d1f0 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85af842640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a806bce0 con 0x7f85a8073060 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85af842640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f85a8072bd0 con 0x7f85a8155200 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85ad5de640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85a8155200 0x7f85a815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85adddf640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85a806d1f0 0x7f85a806d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46208/0 (socket says 172.21.15.26:46208) 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85adddf640 1 -- 172.21.15.26:0/2211230162 learned_addr learned my addr 172.21.15.26:0/2211230162 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85ad5de640 1 -- 172.21.15.26:0/2211230162 >> v1:172.21.15.169:6789/0 conn(0x7f85a8073060 legacy=0x7f85a80c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85ad5de640 1 -- 172.21.15.26:0/2211230162 >> v1:172.21.15.26:6789/0 conn(0x7f85a806d1f0 legacy=0x7f85a806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:48.320 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.320+0000 7f85ad5de640 1 -- 172.21.15.26:0/2211230162 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a8072580 con 0x7f85a8155200 2024-04-25T13:15:48.321 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.321+0000 7f85ad5de640 1 --2- 172.21.15.26:0/2211230162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a8155200 0x7f85a815bac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85a40097a0 tx=0x7f85a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa885ac411df44c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:48.321 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.321+0000 7f859ffff640 1 -- 172.21.15.26:0/2211230162 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4037070 con 0x7f85a8155200 2024-04-25T13:15:48.322 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.321+0000 7f859ffff640 1 -- 172.21.15.26:0/2211230162 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a4032440 con 0x7f85a8155200 2024-04-25T13:15:48.322 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.321+0000 7f859ffff640 1 -- 172.21.15.26:0/2211230162 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4032810 con 0x7f85a8155200 2024-04-25T13:15:48.323 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.322+0000 7f85af842640 1 -- 172.21.15.26:0/2211230162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a8155200 msgr2=0x7f85a815bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:48.323 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.322+0000 7f85af842640 1 --2- 172.21.15.26:0/2211230162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a8155200 0x7f85a815bac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85a40097a0 tx=0x7f85a402a230 comp rx=0 tx=0).stop 2024-04-25T13:15:48.323 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.322+0000 7f85af842640 1 -- 172.21.15.26:0/2211230162 shutdown_connections 2024-04-25T13:15:48.323 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.322+0000 7f85af842640 1 --2- 172.21.15.26:0/2211230162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a8155200 0x7f85a815bac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:48.323 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.322+0000 7f85af842640 1 -- 172.21.15.26:0/2211230162 >> 172.21.15.26:0/2211230162 conn(0x7f85a80cd600 msgr2=0x7f85a80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:48.323 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.322+0000 7f85af842640 1 -- 172.21.15.26:0/2211230162 shutdown_connections 2024-04-25T13:15:48.323 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.322+0000 7f85af842640 1 -- 172.21.15.26:0/2211230162 wait complete. 2024-04-25T13:15:48.324 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.324+0000 7f85af842640 1 Processor -- start 2024-04-25T13:15:48.324 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.324+0000 7f85af842640 1 -- start start 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85af842640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a806d1f0 0x7f85a814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85af842640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85a8073060 0x7f85a81f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85af842640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85a8155200 0x7f85a8151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85af842640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f85a80ce190 con 0x7f85a806d1f0 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85af842640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85a806bf80 con 0x7f85a8155200 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85af842640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f85a806b930 con 0x7f85a8073060 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85ad5de640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a806d1f0 0x7f85a814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85ad5de640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a806d1f0 0x7f85a814c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40388/0 (socket says 172.21.15.26:40388) 2024-04-25T13:15:48.327 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85ad5de640 1 -- 172.21.15.26:0/1489767335 learned_addr learned my addr 172.21.15.26:0/1489767335 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85adddf640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85a8155200 0x7f85a8151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.325+0000 7f85acddd640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85a8073060 0x7f85a81f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85ad5de640 1 -- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85a8073060 msgr2=0x7f85a81f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85ad5de640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85a8073060 0x7f85a81f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85ad5de640 1 -- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85a8155200 msgr2=0x7f85a8151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85ad5de640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85a8155200 0x7f85a8151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85ad5de640 1 -- 172.21.15.26:0/1489767335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a814c580 con 0x7f85a806d1f0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85adddf640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85a8155200 0x7f85a8151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85acddd640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85a8073060 0x7f85a81f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85ad5de640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a806d1f0 0x7f85a814c850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85a4035040 tx=0x7f85a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f859dffb640 1 -- 172.21.15.26:0/1489767335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4037040 con 0x7f85a806d1f0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f859dffb640 1 -- 172.21.15.26:0/1489767335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a4030770 con 0x7f85a806d1f0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f859dffb640 1 -- 172.21.15.26:0/1489767335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4030b40 con 0x7f85a806d1f0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a814bfc0 con 0x7f85a806d1f0 2024-04-25T13:15:48.328 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a81f1240 con 0x7f85a806d1f0 2024-04-25T13:15:48.329 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.326+0000 7f859dffb640 1 -- 172.21.15.26:0/1489767335 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f85a4044020 con 0x7f85a806d1f0 2024-04-25T13:15:48.329 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.327+0000 7f859dffb640 1 -- 172.21.15.26:0/1489767335 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f85a4046ae0 con 0x7f85a806d1f0 2024-04-25T13:15:48.329 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.327+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a8069530 con 0x7f85a806d1f0 2024-04-25T13:15:48.329 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.329+0000 7f859dffb640 1 -- 172.21.15.26:0/1489767335 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f85a8069530 con 0x7f85a806d1f0 2024-04-25T13:15:48.389 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:48.388+0000 7fcdbaa12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:15:48.391 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.392+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85a8153f90 con 0x7f85a806d1f0 2024-04-25T13:15:48.392 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.392+0000 7f859dffb640 1 -- 172.21.15.26:0/1489767335 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f85a4032e20 con 0x7f85a806d1f0 2024-04-25T13:15:48.392 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-25T13:15:48.392 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:15:47.188399+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a806d1f0 msgr2=0x7f85a814c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a806d1f0 0x7f85a814c850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85a4035040 tx=0x7f85a40046c0 comp rx=0 tx=0).stop 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 shutdown_connections 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85a8155200 0x7f85a8151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85a8073060 0x7f85a81f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 --2- 172.21.15.26:0/1489767335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85a806d1f0 0x7f85a814c850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 >> 172.21.15.26:0/1489767335 conn(0x7f85a80cd600 msgr2=0x7f85a81e79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:48.393 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 shutdown_connections 2024-04-25T13:15:48.394 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:48.393+0000 7f85af842640 1 -- 172.21.15.26:0/1489767335 wait complete. 2024-04-25T13:15:48.402 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:15:48.403 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:48.402+0000 7f84767be040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:15:48.439 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:48.438+0000 7fcdbaa12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:15:48.457 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:48.457+0000 7f84767be040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:15:48.507 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:48.507+0000 7fcdbaa12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:48.552 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:48.551+0000 7fcdbaa12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:15:48.578 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:48.578+0000 7f84767be040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:15:48.872 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:48.872+0000 7f84767be040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:15:48.922 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:48.922+0000 7f84767be040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:15:49.035 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:49.034+0000 7fcdbaa12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:15:49.085 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:49.086+0000 7f84767be040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:15:49.149 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:49.148+0000 7fcdbaa12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:15:49.233 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:49.233+0000 7f84767be040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:15:49.284 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:49.285+0000 7f84767be040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:15:49.357 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:49.358+0000 7f84767be040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:49.404 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:49.405+0000 7f84767be040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:15:49.906 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:49.906+0000 7f84767be040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:15:50.027 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-25T13:15:50.028+0000 7f84767be040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:15:50.163 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:50.164+0000 7fcd5b25b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T13:15:50.166 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-25T13:15:50.166+0000 7fcd5b25b640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T13:15:51.287 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-25T13:15:51.287+0000 7f7fd3811640 -1 osd.7 0 log_to_monitors true 2024-04-25T13:15:51.303 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-25T13:15:51.303+0000 7fcf55618640 -1 osd.1 0 log_to_monitors true 2024-04-25T13:15:51.325 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-25T13:15:51.325+0000 7fa916c15640 -1 osd.2 0 log_to_monitors true 2024-04-25T13:15:51.327 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-25T13:15:51.328+0000 7f1b94010640 -1 osd.5 0 log_to_monitors true 2024-04-25T13:15:51.330 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-25T13:15:51.331+0000 7f543581c640 -1 osd.0 0 log_to_monitors true 2024-04-25T13:15:51.337 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-25T13:15:51.338+0000 7efe7941e640 -1 osd.3 0 log_to_monitors true 2024-04-25T13:15:51.345 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-25T13:15:51.346+0000 7fa2ed14c640 -1 osd.4 0 log_to_monitors true 2024-04-25T13:15:51.360 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-25T13:15:51.360+0000 7fb66f940640 -1 osd.6 0 log_to_monitors true 2024-04-25T13:15:54.349 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-25T13:15:54.346+0000 7fcf50fe7640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T13:15:54.357 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-25T13:15:54.357+0000 7fcf48e07640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:54.359 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-25T13:15:54.359+0000 7f54311a0640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T13:15:54.361 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-25T13:15:54.362+0000 7fa9124fb640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T13:15:54.374 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-25T13:15:54.375+0000 7fa90a31b640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:54.375 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-25T13:15:54.375+0000 7f5428fc0640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:54.451 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-25T13:15:54.451+0000 7efe74e59640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T13:15:54.469 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-25T13:15:54.470+0000 7efe6cc8a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:55.075 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-25T13:15:55.075+0000 7fb66b8d6640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T13:15:55.088 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-25T13:15:55.089+0000 7fb6636f6640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:55.102 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-25T13:15:55.101+0000 7f1b8f89d640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T13:15:55.117 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-25T13:15:55.118+0000 7f1b876bd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:55.122 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-25T13:15:55.123+0000 7f7fcf08c640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T13:15:55.136 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-25T13:15:55.137+0000 7f7fc6eac640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:55.156 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-25T13:15:55.156+0000 7fa2e90e2640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T13:15:55.169 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-25T13:15:55.169+0000 7fa2e0f02640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:55.208 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:15:55.310 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.310+0000 7f50e5e35640 1 Processor -- start 2024-04-25T13:15:55.310 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.310+0000 7f50e5e35640 1 -- start start 2024-04-25T13:15:55.311 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50e5e35640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50e006c4f0 0x7f50e0152de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:55.311 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50e5e35640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e01590d0 con 0x7f50e00c6270 2024-04-25T13:15:55.311 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50e5e35640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e0159f70 con 0x7f50e00c5e90 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50e5e35640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f50e00cb760 con 0x7f50e006c4f0 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50e006c4f0 0x7f50e0152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50e006c4f0 0x7f50e0152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58104/0 (socket says 172.21.15.26:58104) 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50dffff640 1 -- 172.21.15.26:0/2001844607 learned_addr learned my addr 172.21.15.26:0/2001844607 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50d7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f50e00c6270 0x7f50e0159860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40166/0 (socket says 172.21.15.26:40166) 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50dffff640 1 -- 172.21.15.26:0/2001844607 >> v1:172.21.15.169:6789/0 conn(0x7f50e00c5e90 legacy=0x7f50e00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50dffff640 1 -- 172.21.15.26:0/2001844607 >> v1:172.21.15.26:6789/0 conn(0x7f50e00c6270 legacy=0x7f50e0159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50deffd640 1 -- 172.21.15.26:0/2001844607 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029373128 0 0) 0x7f50e0159f70 con 0x7f50e00c5e90 2024-04-25T13:15:55.312 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.311+0000 7f50dffff640 1 -- 172.21.15.26:0/2001844607 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e00cb9b0 con 0x7f50e006c4f0 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.312+0000 7f50dffff640 1 --2- 172.21.15.26:0/2001844607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e006c4f0 0x7f50e0152de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea58a7819b5b7273 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.312+0000 7f50deffd640 1 -- 172.21.15.26:0/2001844607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8036070 con 0x7f50e006c4f0 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.312+0000 7f50deffd640 1 -- 172.21.15.26:0/2001844607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d8031600 con 0x7f50e006c4f0 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.312+0000 7f50deffd640 1 -- 172.21.15.26:0/2001844607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d80319d0 con 0x7f50e006c4f0 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.313+0000 7f50e5e35640 1 -- 172.21.15.26:0/2001844607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e006c4f0 msgr2=0x7f50e0152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.313+0000 7f50e5e35640 1 --2- 172.21.15.26:0/2001844607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e006c4f0 0x7f50e0152de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d802a750 comp rx=0 tx=0).stop 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.313+0000 7f50e5e35640 1 -- 172.21.15.26:0/2001844607 shutdown_connections 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.313+0000 7f50e5e35640 1 --2- 172.21.15.26:0/2001844607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e006c4f0 0x7f50e0152de0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.313+0000 7f50e5e35640 1 -- 172.21.15.26:0/2001844607 >> 172.21.15.26:0/2001844607 conn(0x7f50e006eea0 msgr2=0x7f50e006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.313+0000 7f50e5e35640 1 -- 172.21.15.26:0/2001844607 shutdown_connections 2024-04-25T13:15:55.314 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.313+0000 7f50e5e35640 1 -- 172.21.15.26:0/2001844607 wait complete. 2024-04-25T13:15:55.315 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.314+0000 7f50e5e35640 1 Processor -- start 2024-04-25T13:15:55.315 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.314+0000 7f50e5e35640 1 -- start start 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50e5e35640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50e006c4f0 0x7f50e00cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50e5e35640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e00c5e90 0x7f50e014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50e5e35640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50e00c6270 0x7f50e0147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50e5e35640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f50e00cbf70 con 0x7f50e00c5e90 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50e5e35640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50e01593d0 con 0x7f50e006c4f0 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50e5e35640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50e015c5b0 con 0x7f50e00c6270 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e00c5e90 0x7f50e014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e00c5e90 0x7f50e014dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58118/0 (socket says 172.21.15.26:58118) 2024-04-25T13:15:55.317 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 -- 172.21.15.26:0/1552615084 learned_addr learned my addr 172.21.15.26:0/1552615084 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50df7fe640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50e006c4f0 0x7f50e00cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50dffff640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50e00c6270 0x7f50e0147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 -- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50e00c6270 msgr2=0x7f50e0147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50e00c6270 0x7f50e0147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 -- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50e006c4f0 msgr2=0x7f50e00cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50e006c4f0 0x7f50e00cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50d7fff640 1 -- 172.21.15.26:0/1552615084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e01505e0 con 0x7f50e00c5e90 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.315+0000 7f50df7fe640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50e006c4f0 0x7f50e00cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.316+0000 7f50d7fff640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e00c5e90 0x7f50e014dce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c4d0 tx=0x7f50c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.316+0000 7f50dcff9640 1 -- 172.21.15.26:0/1552615084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8018070 con 0x7f50e00c5e90 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.316+0000 7f50dcff9640 1 -- 172.21.15.26:0/1552615084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c80074e0 con 0x7f50e00c5e90 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.316+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e01508c0 con 0x7f50e00c5e90 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.316+0000 7f50dcff9640 1 -- 172.21.15.26:0/1552615084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8007690 con 0x7f50e00c5e90 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.316+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e00c7130 con 0x7f50e00c5e90 2024-04-25T13:15:55.318 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.317+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e0069530 con 0x7f50e00c5e90 2024-04-25T13:15:55.319 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.317+0000 7f50dcff9640 1 -- 172.21.15.26:0/1552615084 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f50c801b070 con 0x7f50e00c5e90 2024-04-25T13:15:55.319 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.318+0000 7f50dcff9640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f50c006c860 0x7f50c006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:55.319 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.318+0000 7f50dcff9640 1 -- 172.21.15.26:0/1552615084 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4191+0+0 (secure 0 0 0) 0x7f50c808a7a0 con 0x7f50e00c5e90 2024-04-25T13:15:55.319 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.318+0000 7f50df7fe640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f50c006c860 0x7f50c006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:55.319 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.319+0000 7f50df7fe640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f50c006c860 0x7f50c006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f50d0001120 tx=0x7f50d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:55.322 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.323+0000 7f50dcff9640 1 -- 172.21.15.26:0/1552615084 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50e0069530 con 0x7f50e00c5e90 2024-04-25T13:15:55.511 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.509+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50e0158eb0 con 0x7f50e00c5e90 2024-04-25T13:15:55.511 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.510+0000 7f50dcff9640 1 -- 172.21.15.26:0/1552615084 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10435 (secure 0 0 0) 0x7f50c80592a0 con 0x7f50e00c5e90 2024-04-25T13:15:55.512 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-25T13:15:55.512 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":13,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:15:55.147729+0000","last_up_change":"2024-04-25T13:15:55.147729+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:15:55.513 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f50c006c860 msgr2=0x7f50c006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:55.513 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f50c006c860 0x7f50c006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f50d0001120 tx=0x7f50d0009040 comp rx=0 tx=0).stop 2024-04-25T13:15:55.513 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e00c5e90 msgr2=0x7f50e014dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:55.513 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e00c5e90 0x7f50e014dce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c4d0 tx=0x7f50c800c990 comp rx=0 tx=0).stop 2024-04-25T13:15:55.513 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 shutdown_connections 2024-04-25T13:15:55.513 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f50c006c860 0x7f50c006ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:55.514 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50e00c6270 0x7f50e0147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:55.514 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e00c5e90 0x7f50e014dce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:55.514 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 --2- 172.21.15.26:0/1552615084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50e006c4f0 0x7f50e00cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:55.514 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 >> 172.21.15.26:0/1552615084 conn(0x7f50e006eea0 msgr2=0x7f50e0150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:55.514 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 shutdown_connections 2024-04-25T13:15:55.514 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:15:55.512+0000 7f50e5e35640 1 -- 172.21.15.26:0/1552615084 wait complete. 2024-04-25T13:15:55.522 DEBUG:teuthology.misc:7 of 8 OSDs are up 2024-04-25T13:16:02.329 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:02.434 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.434+0000 7fbb06356640 1 Processor -- start 2024-04-25T13:16:02.435 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.435+0000 7fbb06356640 1 -- start start 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.435+0000 7fbb06356640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb000ce980 0x7fbb00158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.435+0000 7fbb06356640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb001636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.435+0000 7fbb06356640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb000c93b0 con 0x7fbb000cbe20 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.435+0000 7fbb06356640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbb000c9180 con 0x7fbb000ce980 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.435+0000 7fbb06356640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbb000c9950 con 0x7fbb000c56f0 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbafffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb000ce980 0x7fbb00158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbafffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb000ce980 0x7fbb00158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58124/0 (socket says 172.21.15.26:58124) 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbafffff640 1 -- 172.21.15.26:0/326588367 learned_addr learned my addr 172.21.15.26:0/326588367 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbb048f3640 1 --2- 172.21.15.26:0/326588367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb001636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbafffff640 1 -- 172.21.15.26:0/326588367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 msgr2=0x7fbb001636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbafffff640 1 --2- 172.21.15.26:0/326588367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb001636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbafffff640 1 -- 172.21.15.26:0/326588367 >> v1:172.21.15.169:6789/0 conn(0x7fbb000cbe20 legacy=0x7fbb00152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.436 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.436+0000 7fbafffff640 1 -- 172.21.15.26:0/326588367 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb000c9670 con 0x7fbb000ce980 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbafffff640 1 --2- 172.21.15.26:0/326588367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00158d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb000c9ad0 tx=0x7fbaf002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed55191fa678272f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbafeffd640 1 -- 172.21.15.26:0/326588367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0037070 con 0x7fbb000ce980 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbafeffd640 1 -- 172.21.15.26:0/326588367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf0032440 con 0x7fbb000ce980 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbafeffd640 1 -- 172.21.15.26:0/326588367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0032810 con 0x7fbb000ce980 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 -- 172.21.15.26:0/326588367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 msgr2=0x7fbb00158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 --2- 172.21.15.26:0/326588367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00158d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb000c9ad0 tx=0x7fbaf002a250 comp rx=0 tx=0).stop 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 -- 172.21.15.26:0/326588367 shutdown_connections 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 --2- 172.21.15.26:0/326588367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb001636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 --2- 172.21.15.26:0/326588367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00158d30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 -- 172.21.15.26:0/326588367 >> 172.21.15.26:0/326588367 conn(0x7fbb00073830 msgr2=0x7fbb0006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 -- 172.21.15.26:0/326588367 shutdown_connections 2024-04-25T13:16:02.438 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.437+0000 7fbb06356640 1 -- 172.21.15.26:0/326588367 wait complete. 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.438+0000 7fbb06356640 1 Processor -- start 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.439+0000 7fbb06356640 1 -- start start 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.439+0000 7fbb06356640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb00155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.439+0000 7fbb06356640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb000cbe20 0x7fbb001dee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.439+0000 7fbb06356640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.439+0000 7fbb06356640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbb000cb900 con 0x7fbb000ce980 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.439+0000 7fbb06356640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbb000cb620 con 0x7fbb000cbe20 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.439+0000 7fbb06356640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbb00159270 con 0x7fbb000c56f0 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58134/0 (socket says 172.21.15.26:58134) 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 -- 172.21.15.26:0/964897846 learned_addr learned my addr 172.21.15.26:0/964897846 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbaff7fe640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb000cbe20 0x7fbb001dee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.441 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbafffff640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb00155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 -- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 msgr2=0x7fbb00155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb00155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 -- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb000cbe20 msgr2=0x7fbb001dee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb000cbe20 0x7fbb001dee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 -- 172.21.15.26:0/964897846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb001eef20 con 0x7fbb000ce980 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbaff7fe640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb000cbe20 0x7fbb001dee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb048f3640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00153fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8007e10 tx=0x7fbaf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbafcff9640 1 -- 172.21.15.26:0/964897846 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8014620 con 0x7fbb000ce980 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbafcff9640 1 -- 172.21.15.26:0/964897846 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf8019070 con 0x7fbb000ce980 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb001ef200 con 0x7fbb000ce980 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbafcff9640 1 -- 172.21.15.26:0/964897846 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8014a20 con 0x7fbb000ce980 2024-04-25T13:16:02.442 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.440+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb001ef7c0 con 0x7fbb000ce980 2024-04-25T13:16:02.443 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.441+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb00150c10 con 0x7fbb000ce980 2024-04-25T13:16:02.443 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.442+0000 7fbafcff9640 1 -- 172.21.15.26:0/964897846 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbaf8014bc0 con 0x7fbb000ce980 2024-04-25T13:16:02.443 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.442+0000 7fbafcff9640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbaec06c8f0 0x7fbaec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.443 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.442+0000 7fbafcff9640 1 -- 172.21.15.26:0/964897846 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fbaf808c000 con 0x7fbb000ce980 2024-04-25T13:16:02.444 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.443+0000 7fbafffff640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbaec06c8f0 0x7fbaec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.444 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.443+0000 7fbafffff640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbaec06c8f0 0x7fbaec06edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0034000 tx=0x7fbaf002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.447 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.447+0000 7fbafcff9640 1 -- 172.21.15.26:0/964897846 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb00150c10 con 0x7fbb000ce980 2024-04-25T13:16:02.632 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.633+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb00151690 con 0x7fbb000ce980 2024-04-25T13:16:02.633 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.633+0000 7fbafcff9640 1 -- 172.21.15.26:0/964897846 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7fbaf805a780 con 0x7fbb000ce980 2024-04-25T13:16:02.634 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-25T13:16:02.634 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":16,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:15:58.176929+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:02.635 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbaec06c8f0 msgr2=0x7fbaec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.635 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbaec06c8f0 0x7fbaec06edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0034000 tx=0x7fbaf002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 msgr2=0x7fbb00153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00153fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8007e10 tx=0x7fbaf800e4b0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 shutdown_connections 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbaec06c8f0 0x7fbaec06edb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000ce980 0x7fbb00153fa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb000cbe20 0x7fbb001dee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 --2- 172.21.15.26:0/964897846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb000c56f0 0x7fbb00155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 >> 172.21.15.26:0/964897846 conn(0x7fbb00073830 msgr2=0x7fbb0014fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 shutdown_connections 2024-04-25T13:16:02.636 INFO:teuthology.misc.health.smithi026.stderr:2024-04-25T13:16:02.635+0000 7fbb06356640 1 -- 172.21.15.26:0/964897846 wait complete. 2024-04-25T13:16:02.645 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T13:16:02.645 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T13:16:02.646 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T13:16:02.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T13:16:02.648 INFO:tasks.ceph.mds.a:Started 2024-04-25T13:16:02.648 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T13:16:02.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T13:16:02.650 INFO:tasks.ceph.mds.c:Started 2024-04-25T13:16:02.651 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T13:16:02.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-25T13:16:02.653 INFO:tasks.ceph.mds.e:Started 2024-04-25T13:16:02.653 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T13:16:02.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T13:16:02.656 INFO:tasks.ceph.mds.b:Started 2024-04-25T13:16:02.656 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T13:16:02.656 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T13:16:02.658 INFO:tasks.ceph.mds.d:Started 2024-04-25T13:16:02.658 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T13:16:02.658 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-25T13:16:02.660 INFO:tasks.ceph.mds.f:Started 2024-04-25T13:16:02.660 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T13:16:02.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:02.727 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2024-04-25T13:16:02.728 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2024-04-25T13:16:02.728 INFO:tasks.ceph.mds.e.smithi026.stdout:starting mds.e at 2024-04-25T13:16:02.740 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-04-25T13:16:02.741 INFO:tasks.ceph.mds.f.smithi169.stdout:starting mds.f at 2024-04-25T13:16:02.741 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-04-25T13:16:02.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.769+0000 7fabdbd8e640 1 Processor -- start 2024-04-25T13:16:02.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.769+0000 7fabdbd8e640 1 -- start start 2024-04-25T13:16:02.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabdbd8e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40b2b50 0x7fabd4072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabdbd8e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabd4074390 0x7fabd40728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabdbd8e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd4159de0 con 0x7fabd40c89e0 2024-04-25T13:16:02.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabdbd8e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fabd40b2f30 con 0x7fabd4074390 2024-04-25T13:16:02.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabdbd8e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40c8270 con 0x7fabd40b2b50 2024-04-25T13:16:02.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabd9329640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabd4074390 0x7fabd40728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabda32b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fabd40c89e0 0x7fabd40c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40196/0 (socket says 172.21.15.26:40196) 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.770+0000 7fabda32b640 1 -- 172.21.15.26:0/63550927 learned_addr learned my addr 172.21.15.26:0/63550927 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd9b2a640 1 --2- 172.21.15.26:0/63550927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40b2b50 0x7fabd4072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd9329640 1 -- 172.21.15.26:0/63550927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40b2b50 msgr2=0x7fabd4072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd9329640 1 --2- 172.21.15.26:0/63550927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40b2b50 0x7fabd4072390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd9329640 1 -- 172.21.15.26:0/63550927 >> v1:172.21.15.26:6789/0 conn(0x7fabd40c89e0 legacy=0x7fabd40c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd9329640 1 -- 172.21.15.26:0/63550927 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd4071a50 con 0x7fabd4074390 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd8b28640 1 -- 172.21.15.26:0/63550927 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139553591 0 0) 0x7fabd4159de0 con 0x7fabd40c89e0 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd9b2a640 1 --2- 172.21.15.26:0/63550927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40b2b50 0x7fabd4072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.771+0000 7fabd9329640 1 --2- 172.21.15.26:0/63550927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd4074390 0x7fabd40728d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabd40c83f0 tx=0x7fabc802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4aca73a7395943 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabd8b28640 1 -- 172.21.15.26:0/63550927 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8037070 con 0x7fabd4074390 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabd8b28640 1 -- 172.21.15.26:0/63550927 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8032440 con 0x7fabd4074390 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabd8b28640 1 -- 172.21.15.26:0/63550927 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8032810 con 0x7fabd4074390 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 -- 172.21.15.26:0/63550927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd4074390 msgr2=0x7fabd40728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/63550927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd4074390 0x7fabd40728d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabd40c83f0 tx=0x7fabc802a200 comp rx=0 tx=0).stop 2024-04-25T13:16:02.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 -- 172.21.15.26:0/63550927 shutdown_connections 2024-04-25T13:16:02.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/63550927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd4074390 0x7fabd40728d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/63550927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40b2b50 0x7fabd4072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 -- 172.21.15.26:0/63550927 >> 172.21.15.26:0/63550927 conn(0x7fabd40c9a70 msgr2=0x7fabd40c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:02.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 -- 172.21.15.26:0/63550927 shutdown_connections 2024-04-25T13:16:02.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.772+0000 7fabdbd8e640 1 -- 172.21.15.26:0/63550927 wait complete. 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.773+0000 7fabdbd8e640 1 Processor -- start 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.773+0000 7fabdbd8e640 1 -- start start 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabdbd8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd4074390 0x7fabd41586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabdbd8e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd40b2b50 0x7fabd41ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabdbd8e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40c89e0 0x7fabd41efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabdbd8e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40c84c0 con 0x7fabd40b2b50 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabdbd8e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4072010 con 0x7fabd4074390 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabdbd8e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40c7970 con 0x7fabd40c89e0 2024-04-25T13:16:02.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd40b2b50 0x7fabd41ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd40b2b50 0x7fabd41ef840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58184/0 (socket says 172.21.15.26:58184) 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 -- 172.21.15.26:0/2443828033 learned_addr learned my addr 172.21.15.26:0/2443828033 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9b2a640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd4074390 0x7fabd41586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabda32b640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40c89e0 0x7fabd41efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 -- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40c89e0 msgr2=0x7fabd41efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40c89e0 0x7fabd41efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 -- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd4074390 msgr2=0x7fabd41586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd4074390 0x7fabd41586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9329640 1 -- 172.21.15.26:0/2443828033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd41f2d90 con 0x7fabd40b2b50 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabd9b2a640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd4074390 0x7fabd41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.774+0000 7fabda32b640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40c89e0 0x7fabd41efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.775+0000 7fabd9329640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd40b2b50 0x7fabd41ef840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009890 tx=0x7fabc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.775+0000 7fabd27fc640 1 -- 172.21.15.26:0/2443828033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8037040 con 0x7fabd40b2b50 2024-04-25T13:16:02.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.775+0000 7fabd27fc640 1 -- 172.21.15.26:0/2443828033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8042070 con 0x7fabd40b2b50 2024-04-25T13:16:02.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.775+0000 7fabd27fc640 1 -- 172.21.15.26:0/2443828033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8030bd0 con 0x7fabd40b2b50 2024-04-25T13:16:02.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.775+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd41f3070 con 0x7fabd40b2b50 2024-04-25T13:16:02.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.775+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd41f3630 con 0x7fabd40b2b50 2024-04-25T13:16:02.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.776+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd40735f0 con 0x7fabd40b2b50 2024-04-25T13:16:02.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.777+0000 7fabd27fc640 1 -- 172.21.15.26:0/2443828033 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabc8047460 con 0x7fabd40b2b50 2024-04-25T13:16:02.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.777+0000 7fabd27fc640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fabc006c8f0 0x7fabc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.777+0000 7fabd27fc640 1 -- 172.21.15.26:0/2443828033 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fabc80ac3d0 con 0x7fabd40b2b50 2024-04-25T13:16:02.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.777+0000 7fabd9b2a640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fabc006c8f0 0x7fabc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.778+0000 7fabd9b2a640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fabc006c8f0 0x7fabc006edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fabcc006fd0 tx=0x7fabcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.781+0000 7fabd27fc640 1 -- 172.21.15.26:0/2443828033 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fabd40735f0 con 0x7fabd40b2b50 2024-04-25T13:16:02.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.967+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabd406e0c0 con 0x7fabd40b2b50 2024-04-25T13:16:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.968+0000 7fabd27fc640 1 -- 172.21.15.26:0/2443828033 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7fabd406e0c0 con 0x7fabd40b2b50 2024-04-25T13:16:02.968 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:02.968 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:15:58.176929+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:02.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fabc006c8f0 msgr2=0x7fabc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fabc006c8f0 0x7fabc006edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fabcc006fd0 tx=0x7fabcc008040 comp rx=0 tx=0).stop 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd40b2b50 msgr2=0x7fabd41ef840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd40b2b50 0x7fabd41ef840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009890 tx=0x7fabc80046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 shutdown_connections 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fabc006c8f0 0x7fabc006edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabd40c89e0 0x7fabd41efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabd40b2b50 0x7fabd41ef840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 --2- 172.21.15.26:0/2443828033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd4074390 0x7fabd41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 >> 172.21.15.26:0/2443828033 conn(0x7fabd40c9a70 msgr2=0x7fabd40cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 shutdown_connections 2024-04-25T13:16:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:02.970+0000 7fabdbd8e640 1 -- 172.21.15.26:0/2443828033 wait complete. 2024-04-25T13:16:02.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:16:02.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:03.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.084+0000 7fe31a119640 1 Processor -- start 2024-04-25T13:16:03.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.084+0000 7fe31a119640 1 -- start start 2024-04-25T13:16:03.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe31a119640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3140c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe31a119640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe31415baf0 0x7fe314074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe31a119640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe314075290 0x7fe31415c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe31a119640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe314072380 con 0x7fe314075290 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe31a119640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe314072660 con 0x7fe31415baf0 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe31a119640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe314072940 con 0x7fe314144150 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe313fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe314075290 0x7fe31415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe313fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe314075290 0x7fe31415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58188/0 (socket says 172.21.15.26:58188) 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.085+0000 7fe313fff640 1 -- 172.21.15.26:0/1097294341 learned_addr learned my addr 172.21.15.26:0/1097294341 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe3137fe640 1 --2- 172.21.15.26:0/1097294341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3140c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe312ffd640 1 --2- 172.21.15.26:0/1097294341 >> v2:172.21.15.169:3300/0 conn(0x7fe31415baf0 0x7fe314074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe313fff640 1 -- 172.21.15.26:0/1097294341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 msgr2=0x7fe3140c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe313fff640 1 --2- 172.21.15.26:0/1097294341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3140c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe313fff640 1 -- 172.21.15.26:0/1097294341 >> v2:172.21.15.169:3300/0 conn(0x7fe31415baf0 msgr2=0x7fe314074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe313fff640 1 --2- 172.21.15.26:0/1097294341 >> v2:172.21.15.169:3300/0 conn(0x7fe31415baf0 0x7fe314074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe313fff640 1 -- 172.21.15.26:0/1097294341 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe314072c20 con 0x7fe314075290 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe3137fe640 1 --2- 172.21.15.26:0/1097294341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3140c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.086+0000 7fe313fff640 1 --2- 172.21.15.26:0/1097294341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe314075290 0x7fe31415c660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3140cb090 tx=0x7fe30c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf62b8bdd715726d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:03.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe3127fc640 1 -- 172.21.15.26:0/1097294341 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c036070 con 0x7fe314075290 2024-04-25T13:16:03.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe3127fc640 1 -- 172.21.15.26:0/1097294341 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c031600 con 0x7fe314075290 2024-04-25T13:16:03.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe3127fc640 1 -- 172.21.15.26:0/1097294341 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0319d0 con 0x7fe314075290 2024-04-25T13:16:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 -- 172.21.15.26:0/1097294341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe314075290 msgr2=0x7fe31415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 --2- 172.21.15.26:0/1097294341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe314075290 0x7fe31415c660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3140cb090 tx=0x7fe30c02a730 comp rx=0 tx=0).stop 2024-04-25T13:16:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 -- 172.21.15.26:0/1097294341 shutdown_connections 2024-04-25T13:16:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 --2- 172.21.15.26:0/1097294341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe314075290 0x7fe31415c660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 --2- 172.21.15.26:0/1097294341 >> v2:172.21.15.169:3300/0 conn(0x7fe31415baf0 0x7fe314074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 --2- 172.21.15.26:0/1097294341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3140c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 -- 172.21.15.26:0/1097294341 >> 172.21.15.26:0/1097294341 conn(0x7fe31406b920 msgr2=0x7fe31406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 -- 172.21.15.26:0/1097294341 shutdown_connections 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.087+0000 7fe31a119640 1 -- 172.21.15.26:0/1097294341 wait complete. 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.088+0000 7fe31a119640 1 Processor -- start 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe31a119640 1 -- start start 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe31a119640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe314075290 0x7fe3141f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe31a119640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3141f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe31a119640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe31415baf0 0x7fe314156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe31a119640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe314144530 con 0x7fe31415baf0 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe31a119640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe31415bf10 con 0x7fe314075290 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe31a119640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3140705c0 con 0x7fe314144150 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe313fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe31415baf0 0x7fe314156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe313fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe31415baf0 0x7fe314156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58198/0 (socket says 172.21.15.26:58198) 2024-04-25T13:16:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe313fff640 1 -- 172.21.15.26:0/2260405292 learned_addr learned my addr 172.21.15.26:0/2260405292 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe312ffd640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3141f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.089+0000 7fe3137fe640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe314075290 0x7fe3141f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe313fff640 1 -- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 msgr2=0x7fe3141f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe313fff640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3141f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe313fff640 1 -- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe314075290 msgr2=0x7fe3141f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe313fff640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe314075290 0x7fe3141f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe313fff640 1 -- 172.21.15.26:0/2260405292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe314155eb0 con 0x7fe31415baf0 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe312ffd640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3141f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe313fff640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe31415baf0 0x7fe314156690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009f40 tx=0x7fe30c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe2fbfff640 1 -- 172.21.15.26:0/2260405292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c036050 con 0x7fe31415baf0 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe2fbfff640 1 -- 172.21.15.26:0/2260405292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c042070 con 0x7fe31415baf0 2024-04-25T13:16:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3141f5670 con 0x7fe31415baf0 2024-04-25T13:16:03.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe2fbfff640 1 -- 172.21.15.26:0/2260405292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c009510 con 0x7fe31415baf0 2024-04-25T13:16:03.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.090+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3141e6980 con 0x7fe31415baf0 2024-04-25T13:16:03.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.091+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31415b750 con 0x7fe31415baf0 2024-04-25T13:16:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.091+0000 7fe2fbfff640 1 -- 172.21.15.26:0/2260405292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe30c007c70 con 0x7fe31415baf0 2024-04-25T13:16:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.092+0000 7fe2fbfff640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe30006c920 0x7fe30006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.092+0000 7fe2fbfff640 1 -- 172.21.15.26:0/2260405292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe30c0ac570 con 0x7fe31415baf0 2024-04-25T13:16:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.092+0000 7fe3137fe640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe30006c920 0x7fe30006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.093+0000 7fe3137fe640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe30006c920 0x7fe30006ede0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe304006fd0 tx=0x7fe304008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:03.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.096+0000 7fe2fbfff640 1 -- 172.21.15.26:0/2260405292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe31415b750 con 0x7fe31415baf0 2024-04-25T13:16:03.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.281+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe314068f50 con 0x7fe31415baf0 2024-04-25T13:16:03.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.282+0000 7fe2fbfff640 1 -- 172.21.15.26:0/2260405292 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fe30c045360 con 0x7fe31415baf0 2024-04-25T13:16:03.282 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.283+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe30006c920 msgr2=0x7fe30006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.283+0000 7fe31a119640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe30006c920 0x7fe30006ede0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe304006fd0 tx=0x7fe304008040 comp rx=0 tx=0).stop 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.283+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe31415baf0 msgr2=0x7fe314156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.283+0000 7fe31a119640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe31415baf0 0x7fe314156690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009f40 tx=0x7fe30c004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 shutdown_connections 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe30006c920 0x7fe30006ede0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe31415baf0 0x7fe314156690 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe314144150 0x7fe3141f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 --2- 172.21.15.26:0/2260405292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe314075290 0x7fe3141f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 >> 172.21.15.26:0/2260405292 conn(0x7fe31406b920 msgr2=0x7fe3140c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 shutdown_connections 2024-04-25T13:16:03.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.284+0000 7fe31a119640 1 -- 172.21.15.26:0/2260405292 wait complete. 2024-04-25T13:16:03.294 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.395+0000 7fb377605640 1 Processor -- start 2024-04-25T13:16:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.395+0000 7fb377605640 1 -- start start 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb377605640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb3700b3c00 0x7fb3700b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb377605640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3701558c0 con 0x7fb3700b5450 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb377605640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3700cb8c0 con 0x7fb3701554e0 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb377605640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb3700b4a80 con 0x7fb3700b3c00 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb375ba2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb3700b5450 0x7fb3700d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40212/0 (socket says 172.21.15.26:40212) 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb375ba2640 1 -- 172.21.15.26:0/2831139369 learned_addr learned my addr 172.21.15.26:0/2831139369 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476855358 0 0) 0x7fb360001490 con 0x7fb3700b5450 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb358003520 con 0x7fb3700b5450 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.396+0000 7fb374ba0640 1 --2- 172.21.15.26:0/2831139369 >> v2:172.21.15.169:3300/0 conn(0x7fb3700b3c00 0x7fb3700b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3574263093 0 0) 0x7fb358003520 con 0x7fb3700b5450 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 >> v2:172.21.15.169:3300/0 conn(0x7fb3700b3c00 msgr2=0x7fb3700b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 --2- 172.21.15.26:0/2831139369 >> v2:172.21.15.169:3300/0 conn(0x7fb3700b3c00 0x7fb3700b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 >> v1:172.21.15.169:6789/0 conn(0x7fb3701554e0 legacy=0x7fb37015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3700cbba0 con 0x7fb3700b5450 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7fb360001bc0 con 0x7fb3700b5450 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 >> v1:172.21.15.26:6789/0 conn(0x7fb3700b5450 legacy=0x7fb3700d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580039b0 0x7fb358003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb358004800 0x7fb358004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580051c0 0x7fb35800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3700b4a80 con 0x7fb3580039b0 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb35800c070 con 0x7fb3580051c0 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb35800c270 con 0x7fb358004800 2024-04-25T13:16:03.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb3753a1640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580039b0 0x7fb358003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb375ba2640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580051c0 0x7fb35800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb374ba0640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb358004800 0x7fb358004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb3753a1640 1 -- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb358004800 msgr2=0x7fb358004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb3753a1640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb358004800 0x7fb358004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb3753a1640 1 -- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580051c0 msgr2=0x7fb35800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb3753a1640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580051c0 0x7fb35800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb3753a1640 1 -- 172.21.15.26:0/2831139369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb358003520 con 0x7fb3580039b0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.397+0000 7fb375ba2640 1 -- 172.21.15.26:0/2831139369 reap_dead start 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.398+0000 7fb3753a1640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580039b0 0x7fb358003dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb368001750 tx=0x7fb358005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb465dc0c453fc24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.398+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368001370 con 0x7fb3580039b0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.398+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3680052d0 con 0x7fb3580039b0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.398+0000 7fb36ffff640 1 -- 172.21.15.26:0/2831139369 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36802abc0 con 0x7fb3580039b0 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.399+0000 7fb377605640 1 -- 172.21.15.26:0/2831139369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580039b0 msgr2=0x7fb358003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.399+0000 7fb377605640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580039b0 0x7fb358003dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb368001750 tx=0x7fb358005830 comp rx=0 tx=0).stop 2024-04-25T13:16:03.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.399+0000 7fb377605640 1 -- 172.21.15.26:0/2831139369 shutdown_connections 2024-04-25T13:16:03.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.399+0000 7fb377605640 1 --2- 172.21.15.26:0/2831139369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580039b0 0x7fb358003dd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.399+0000 7fb377605640 1 -- 172.21.15.26:0/2831139369 >> 172.21.15.26:0/2831139369 conn(0x7fb370074d50 msgr2=0x7fb370075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:03.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.399+0000 7fb377605640 1 -- 172.21.15.26:0/2831139369 shutdown_connections 2024-04-25T13:16:03.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.399+0000 7fb377605640 1 -- 172.21.15.26:0/2831139369 wait complete. 2024-04-25T13:16:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.400+0000 7fb377605640 1 Processor -- start 2024-04-25T13:16:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.400+0000 7fb377605640 1 -- start start 2024-04-25T13:16:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.400+0000 7fb377605640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580039b0 0x7fb3700cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb377605640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37015f290 0x7fb3701f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb377605640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37014e970 0x7fb37014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb377605640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3700b4710 con 0x7fb37015f290 2024-04-25T13:16:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb377605640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb3700b4430 con 0x7fb3580039b0 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb377605640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb3700b3580 con 0x7fb37014e970 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37015f290 0x7fb3701f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37015f290 0x7fb3701f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58218/0 (socket says 172.21.15.26:58218) 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 -- 172.21.15.26:0/1199704914 learned_addr learned my addr 172.21.15.26:0/1199704914 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb3753a1640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580039b0 0x7fb3700cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb375ba2640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37014e970 0x7fb37014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 -- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37014e970 msgr2=0x7fb37014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37014e970 0x7fb37014abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 -- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580039b0 msgr2=0x7fb3700cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580039b0 0x7fb3700cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 -- 172.21.15.26:0/1199704914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37015e910 con 0x7fb37015f290 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb374ba0640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37015f290 0x7fb3701f4910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb364011990 tx=0x7fb364011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb36dffb640 1 -- 172.21.15.26:0/1199704914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36400fad0 con 0x7fb37015f290 2024-04-25T13:16:03.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb36dffb640 1 -- 172.21.15.26:0/1199704914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36400fc70 con 0x7fb37015f290 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37014d300 con 0x7fb37015f290 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb36dffb640 1 -- 172.21.15.26:0/1199704914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364014440 con 0x7fb37015f290 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.401+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37014bf00 con 0x7fb37015f290 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.403+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb370068e40 con 0x7fb37015f290 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.403+0000 7fb36dffb640 1 -- 172.21.15.26:0/1199704914 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb364012040 con 0x7fb37015f290 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.403+0000 7fb36dffb640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb35c06c8f0 0x7fb35c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.404+0000 7fb36dffb640 1 -- 172.21.15.26:0/1199704914 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb36408bf30 con 0x7fb37015f290 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.404+0000 7fb3753a1640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb35c06c8f0 0x7fb35c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:03.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.404+0000 7fb3753a1640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb35c06c8f0 0x7fb35c06edb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb368032000 tx=0x7fb36802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:03.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.408+0000 7fb36dffb640 1 -- 172.21.15.26:0/1199704914 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb364019030 con 0x7fb37015f290 2024-04-25T13:16:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.639+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3700cca70 con 0x7fb37015f290 2024-04-25T13:16:03.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.639+0000 7fb36dffb640 1 -- 172.21.15.26:0/1199704914 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fb36405a620 con 0x7fb37015f290 2024-04-25T13:16:03.639 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:03.639 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T13:16:03.639 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2024-04-25T13:16:03.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb35c06c8f0 msgr2=0x7fb35c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb35c06c8f0 0x7fb35c06edb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb368032000 tx=0x7fb36802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:03.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37015f290 msgr2=0x7fb3701f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37015f290 0x7fb3701f4910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb364011990 tx=0x7fb364011e50 comp rx=0 tx=0).stop 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 shutdown_connections 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb35c06c8f0 0x7fb35c06edb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37014e970 0x7fb37014abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37015f290 0x7fb3701f4910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 --2- 172.21.15.26:0/1199704914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3580039b0 0x7fb3700cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.641+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 >> 172.21.15.26:0/1199704914 conn(0x7fb370074d50 msgr2=0x7fb370075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.642+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 shutdown_connections 2024-04-25T13:16:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:03.642+0000 7fb377605640 1 -- 172.21.15.26:0/1199704914 wait complete. 2024-04-25T13:16:05.652 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:05.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.765+0000 7f4d2e795640 1 Processor -- start 2024-04-25T13:16:05.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.765+0000 7f4d2e795640 1 -- start start 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.766+0000 7f4d2e795640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4d280d08a0 0x7f4d280d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.766+0000 7f4d2e795640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d281558c0 con 0x7f4d281554e0 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.766+0000 7f4d2e795640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d280cb8c0 con 0x7f4d280b3c00 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.766+0000 7f4d2e795640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4d280b4a80 con 0x7f4d280d08a0 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.766+0000 7f4d27fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d281554e0 0x7f4d2815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46560/0 (socket says 172.21.15.26:46560) 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.766+0000 7f4d27fff640 1 -- 172.21.15.26:0/3466079783 learned_addr learned my addr 172.21.15.26:0/3466079783 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d2cd32640 1 --2- 172.21.15.26:0/3466079783 >> v2:172.21.15.169:3300/0 conn(0x7f4d280d08a0 0x7f4d280d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080985588 0 0) 0x7f4d18001110 con 0x7f4d281554e0 2024-04-25T13:16:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d10003520 con 0x7f4d281554e0 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2608856588 0 0) 0x7f4d10003520 con 0x7f4d281554e0 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 >> v2:172.21.15.169:3300/0 conn(0x7f4d280d08a0 msgr2=0x7f4d280d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 --2- 172.21.15.26:0/3466079783 >> v2:172.21.15.169:3300/0 conn(0x7f4d280d08a0 0x7f4d280d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 >> v1:172.21.15.169:6789/0 conn(0x7f4d280b3c00 legacy=0x7f4d280b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d280cbba0 con 0x7f4d281554e0 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f4d18001840 con 0x7f4d281554e0 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 >> v1:172.21.15.26:6789/0 conn(0x7f4d281554e0 legacy=0x7f4d2815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d100039b0 0x7f4d10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d10004800 0x7f4d10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4d280b4a80 con 0x7f4d100051c0 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1000c070 con 0x7f4d100039b0 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1000c270 con 0x7f4d10004800 2024-04-25T13:16:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d2cd32640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d27fff640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d100039b0 0x7f4d10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d277fe640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d10004800 0x7f4d10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d2cd32640 1 -- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d10004800 msgr2=0x7f4d10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d2cd32640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d10004800 0x7f4d10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d2cd32640 1 -- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d100039b0 msgr2=0x7f4d10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d2cd32640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d100039b0 0x7f4d10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.767+0000 7f4d2cd32640 1 -- 172.21.15.26:0/3466079783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d10003520 con 0x7f4d100051c0 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.768+0000 7f4d2cd32640 1 -- 172.21.15.26:0/3466079783 reap_dead start 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.768+0000 7f4d2cd32640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d1000b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009fc0 tx=0x7f4d10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506c913ecdd6e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.768+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20035020 con 0x7f4d100051c0 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.768+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d20003bd0 con 0x7f4d100051c0 2024-04-25T13:16:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.768+0000 7f4d26ffd640 1 -- 172.21.15.26:0/3466079783 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20009c10 con 0x7f4d100051c0 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.769+0000 7f4d2e795640 1 -- 172.21.15.26:0/3466079783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 msgr2=0x7f4d1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.769+0000 7f4d2e795640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d1000b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009fc0 tx=0x7f4d10005830 comp rx=0 tx=0).stop 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.769+0000 7f4d2e795640 1 -- 172.21.15.26:0/3466079783 shutdown_connections 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.769+0000 7f4d2e795640 1 --2- 172.21.15.26:0/3466079783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d1000b9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.769+0000 7f4d2e795640 1 -- 172.21.15.26:0/3466079783 >> 172.21.15.26:0/3466079783 conn(0x7f4d28074d50 msgr2=0x7f4d28075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.769+0000 7f4d2e795640 1 -- 172.21.15.26:0/3466079783 shutdown_connections 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.769+0000 7f4d2e795640 1 -- 172.21.15.26:0/3466079783 wait complete. 2024-04-25T13:16:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.770+0000 7f4d2e795640 1 Processor -- start 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.770+0000 7f4d2e795640 1 -- start start 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d2e795640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d28150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d2e795640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d280c6c10 0x7f4d281f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d2e795640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d280c9b20 0x7f4d281f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d2e795640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4d280b4710 con 0x7f4d100051c0 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d2e795640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d280b4430 con 0x7f4d280c6c10 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d2e795640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d280b3580 con 0x7f4d280c9b20 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d28150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d28150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57990/0 (socket says 172.21.15.26:57990) 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d27fff640 1 -- 172.21.15.26:0/1452118164 learned_addr learned my addr 172.21.15.26:0/1452118164 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d2cd32640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d280c9b20 0x7f4d281f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.771+0000 7f4d277fe640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d280c6c10 0x7f4d281f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d27fff640 1 -- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d280c9b20 msgr2=0x7f4d281f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d27fff640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d280c9b20 0x7f4d281f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d27fff640 1 -- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d280c6c10 msgr2=0x7f4d281f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d27fff640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d280c6c10 0x7f4d281f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d27fff640 1 -- 172.21.15.26:0/1452118164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d281e1570 con 0x7f4d100051c0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d27fff640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d28150380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d18007290 tx=0x7f4d18007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d24ff9640 1 -- 172.21.15.26:0/1452118164 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18001230 con 0x7f4d100051c0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d24ff9640 1 -- 172.21.15.26:0/1452118164 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d18018070 con 0x7f4d100051c0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d280c51d0 con 0x7f4d100051c0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d24ff9640 1 -- 172.21.15.26:0/1452118164 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800fc00 con 0x7f4d100051c0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.772+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d280c5750 con 0x7f4d100051c0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.773+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d28151fa0 con 0x7f4d100051c0 2024-04-25T13:16:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.773+0000 7f4d24ff9640 1 -- 172.21.15.26:0/1452118164 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d1801d460 con 0x7f4d100051c0 2024-04-25T13:16:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.774+0000 7f4d24ff9640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4d1406c8f0 0x7f4d1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.774+0000 7f4d24ff9640 1 -- 172.21.15.26:0/1452118164 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4d1808b7d0 con 0x7f4d100051c0 2024-04-25T13:16:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.774+0000 7f4d277fe640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4d1406c8f0 0x7f4d1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.775+0000 7f4d277fe640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4d1406c8f0 0x7f4d1406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d280cde40 tx=0x7f4d1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:05.779+0000 7f4d24ff9640 1 -- 172.21.15.26:0/1452118164 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d28151fa0 con 0x7f4d100051c0 2024-04-25T13:16:05.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:05.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:06.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.001+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d280caf80 con 0x7f4d100051c0 2024-04-25T13:16:06.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.002+0000 7f4d24ff9640 1 -- 172.21.15.26:0/1452118164 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5515 (secure 0 0 0) 0x7f4d280caf80 con 0x7f4d100051c0 2024-04-25T13:16:06.002 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:06.002 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4308,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:16:06.002 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4d1406c8f0 msgr2=0x7f4d1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4d1406c8f0 0x7f4d1406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d280cde40 tx=0x7f4d1c009040 comp rx=0 tx=0).stop 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 msgr2=0x7f4d28150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d28150380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d18007290 tx=0x7f4d18007750 comp rx=0 tx=0).stop 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 shutdown_connections 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4d1406c8f0 0x7f4d1406edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d280c9b20 0x7f4d281f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d280c6c10 0x7f4d281f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 --2- 172.21.15.26:0/1452118164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d100051c0 0x7f4d28150380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 >> 172.21.15.26:0/1452118164 conn(0x7f4d28074d50 msgr2=0x7f4d28151890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 shutdown_connections 2024-04-25T13:16:06.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.004+0000 7f4d2e795640 1 -- 172.21.15.26:0/1452118164 wait complete. 2024-04-25T13:16:06.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:06.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.164+0000 7fd6fb642640 1 Processor -- start 2024-04-25T13:16:06.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.164+0000 7fd6fb642640 1 -- start start 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6fb642640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6f40b3c00 0x7fd6f40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6fb642640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd6f40b5450 0x7fd6f40d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6fb642640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f41558c0 con 0x7fd6f41554e0 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6fb642640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f40b4a80 con 0x7fd6f40b3c00 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6fb642640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f40cb8c0 con 0x7fd6f40b5450 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f8bdd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6f40b3c00 0x7fd6f40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f93de640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6f41554e0 0x7fd6f415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46570/0 (socket says 172.21.15.26:46570) 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f93de640 1 -- 172.21.15.26:0/1731263699 learned_addr learned my addr 172.21.15.26:0/1731263699 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f9bdf640 1 --2- 172.21.15.26:0/1731263699 >> v2:172.21.15.169:3300/0 conn(0x7fd6f40b5450 0x7fd6f40d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f8bdd640 1 -- 172.21.15.26:0/1731263699 >> v2:172.21.15.169:3300/0 conn(0x7fd6f40b5450 msgr2=0x7fd6f40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f8bdd640 1 --2- 172.21.15.26:0/1731263699 >> v2:172.21.15.169:3300/0 conn(0x7fd6f40b5450 0x7fd6f40d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f8bdd640 1 -- 172.21.15.26:0/1731263699 >> v1:172.21.15.26:6789/0 conn(0x7fd6f41554e0 legacy=0x7fd6f415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.165+0000 7fd6f8bdd640 1 -- 172.21.15.26:0/1731263699 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f40cbba0 con 0x7fd6f40b3c00 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.166+0000 7fd6f8bdd640 1 --2- 172.21.15.26:0/1731263699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f40b3c00 0x7fd6f40b4f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40ce7e0 tx=0x7fd6e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f6cd84f28640c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.166+0000 7fd6ebfff640 1 -- 172.21.15.26:0/1731263699 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4037070 con 0x7fd6f40b3c00 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.166+0000 7fd6ebfff640 1 -- 172.21.15.26:0/1731263699 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e4032440 con 0x7fd6f40b3c00 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.166+0000 7fd6ebfff640 1 -- 172.21.15.26:0/1731263699 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4032810 con 0x7fd6f40b3c00 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 -- 172.21.15.26:0/1731263699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f40b3c00 msgr2=0x7fd6f40b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 --2- 172.21.15.26:0/1731263699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f40b3c00 0x7fd6f40b4f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40ce7e0 tx=0x7fd6e402a230 comp rx=0 tx=0).stop 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 -- 172.21.15.26:0/1731263699 shutdown_connections 2024-04-25T13:16:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 --2- 172.21.15.26:0/1731263699 >> v2:172.21.15.169:3300/0 conn(0x7fd6f40b5450 0x7fd6f40d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 --2- 172.21.15.26:0/1731263699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f40b3c00 0x7fd6f40b4f10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 -- 172.21.15.26:0/1731263699 >> 172.21.15.26:0/1731263699 conn(0x7fd6f4074d50 msgr2=0x7fd6f4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 -- 172.21.15.26:0/1731263699 shutdown_connections 2024-04-25T13:16:06.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.167+0000 7fd6fb642640 1 -- 172.21.15.26:0/1731263699 wait complete. 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 Processor -- start 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 -- start start 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b3c00 0x7fd6f41e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40b5450 0x7fd6f4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f41554e0 0x7fd6f4159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f40b4710 con 0x7fd6f41554e0 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f40b4430 con 0x7fd6f40b5450 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.168+0000 7fd6fb642640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f40b3580 con 0x7fd6f40b3c00 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f41554e0 0x7fd6f4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f41554e0 0x7fd6f4159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58012/0 (socket says 172.21.15.26:58012) 2024-04-25T13:16:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 -- 172.21.15.26:0/712652553 learned_addr learned my addr 172.21.15.26:0/712652553 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f8bdd640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40b5450 0x7fd6f4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f93de640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b3c00 0x7fd6f41e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 -- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b3c00 msgr2=0x7fd6f41e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b3c00 0x7fd6f41e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 -- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40b5450 msgr2=0x7fd6f4159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40b5450 0x7fd6f4159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 -- 172.21.15.26:0/712652553 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f415ba80 con 0x7fd6f41554e0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f93de640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b3c00 0x7fd6f41e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f8bdd640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40b5450 0x7fd6f4159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6f9bdf640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f41554e0 0x7fd6f4159850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec007e40 tx=0x7fd6ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6e9ffb640 1 -- 172.21.15.26:0/712652553 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec014620 con 0x7fd6f41554e0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6e9ffb640 1 -- 172.21.15.26:0/712652553 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ec019070 con 0x7fd6f41554e0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f41572f0 con 0x7fd6f41554e0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6e9ffb640 1 -- 172.21.15.26:0/712652553 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec014a20 con 0x7fd6f41554e0 2024-04-25T13:16:06.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.169+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f41585d0 con 0x7fd6f41554e0 2024-04-25T13:16:06.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.171+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f4068e40 con 0x7fd6f41554e0 2024-04-25T13:16:06.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.171+0000 7fd6e9ffb640 1 -- 172.21.15.26:0/712652553 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6ec014bc0 con 0x7fd6f41554e0 2024-04-25T13:16:06.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.171+0000 7fd6e9ffb640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd6d806c8f0 0x7fd6d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.171+0000 7fd6e9ffb640 1 -- 172.21.15.26:0/712652553 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd6ec08c0c0 con 0x7fd6f41554e0 2024-04-25T13:16:06.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.172+0000 7fd6f93de640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd6d806c8f0 0x7fd6d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.172+0000 7fd6f93de640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd6d806c8f0 0x7fd6d806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0000f60 tx=0x7fd6f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.175+0000 7fd6e9ffb640 1 -- 172.21.15.26:0/712652553 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6ec05a840 con 0x7fd6f41554e0 2024-04-25T13:16:06.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.361+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6f4158d80 con 0x7fd6f41554e0 2024-04-25T13:16:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.361+0000 7fd6e9ffb640 1 -- 172.21.15.26:0/712652553 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7fd6ec05a140 con 0x7fd6f41554e0 2024-04-25T13:16:06.361 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:06.361 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:15:58.176929+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd6d806c8f0 msgr2=0x7fd6d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd6d806c8f0 0x7fd6d806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0000f60 tx=0x7fd6f0009040 comp rx=0 tx=0).stop 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f41554e0 msgr2=0x7fd6f4159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f41554e0 0x7fd6f4159850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec007e40 tx=0x7fd6ec00e4b0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 shutdown_connections 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd6d806c8f0 0x7fd6d806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f41554e0 0x7fd6f4159850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40b5450 0x7fd6f4159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.363+0000 7fd6fb642640 1 --2- 172.21.15.26:0/712652553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b3c00 0x7fd6f41e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.364+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 >> 172.21.15.26:0/712652553 conn(0x7fd6f4074d50 msgr2=0x7fd6f40ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.364+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 shutdown_connections 2024-04-25T13:16:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.364+0000 7fd6fb642640 1 -- 172.21.15.26:0/712652553 wait complete. 2024-04-25T13:16:06.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:16:06.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:06.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.478+0000 7feeb66e8640 1 Processor -- start 2024-04-25T13:16:06.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.478+0000 7feeb66e8640 1 -- start start 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb66e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb66e8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feeb00cc710 0x7feeb0073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb66e8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb015be60 con 0x7feeb00b3600 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb66e8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7feeb015e650 con 0x7feeb00cc710 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb66e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feeb015e930 con 0x7feeb0154f00 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb4c85640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feeb00cc710 0x7feeb0073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb4c85640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feeb00cc710 0x7feeb0073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58020/0 (socket says 172.21.15.26:58020) 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb4c85640 1 -- 172.21.15.26:0/957535135 learned_addr learned my addr 172.21.15.26:0/957535135 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeaffff640 1 --2- 172.21.15.26:0/957535135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb4c85640 1 -- 172.21.15.26:0/957535135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 msgr2=0x7feeb0073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb4c85640 1 --2- 172.21.15.26:0/957535135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0073110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb4c85640 1 -- 172.21.15.26:0/957535135 >> v1:172.21.15.169:6789/0 conn(0x7feeb00b3600 legacy=0x7feeb00cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.479+0000 7feeb4c85640 1 -- 172.21.15.26:0/957535135 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb015ec10 con 0x7feeb00cc710 2024-04-25T13:16:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.480+0000 7feeb4c85640 1 --2- 172.21.15.26:0/957535135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb0073650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feea8009e50 tx=0x7feea802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ce7313a8919bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.480+0000 7feeaeffd640 1 -- 172.21.15.26:0/957535135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8036070 con 0x7feeb00cc710 2024-04-25T13:16:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.480+0000 7feeaeffd640 1 -- 172.21.15.26:0/957535135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8031600 con 0x7feeb00cc710 2024-04-25T13:16:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.480+0000 7feeaeffd640 1 -- 172.21.15.26:0/957535135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea80319d0 con 0x7feeb00cc710 2024-04-25T13:16:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 -- 172.21.15.26:0/957535135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 msgr2=0x7feeb0073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 --2- 172.21.15.26:0/957535135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb0073650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feea8009e50 tx=0x7feea802a6c0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 -- 172.21.15.26:0/957535135 shutdown_connections 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 --2- 172.21.15.26:0/957535135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb0073650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 --2- 172.21.15.26:0/957535135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 -- 172.21.15.26:0/957535135 >> 172.21.15.26:0/957535135 conn(0x7feeb0068570 msgr2=0x7feeb0071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 -- 172.21.15.26:0/957535135 shutdown_connections 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.481+0000 7feeb66e8640 1 -- 172.21.15.26:0/957535135 wait complete. 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.482+0000 7feeb66e8640 1 Processor -- start 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.482+0000 7feeb66e8640 1 -- start start 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeb00b3600 0x7feeb00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feeb01552e0 con 0x7feeb00cc710 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00cb230 con 0x7feeb00b3600 2024-04-25T13:16:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feeb01f1070 con 0x7feeb0154f00 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58030/0 (socket says 172.21.15.26:58030) 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 -- 172.21.15.26:0/1371568646 learned_addr learned my addr 172.21.15.26:0/1371568646 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb4c85640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaffff640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeb00b3600 0x7feeb00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 -- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 msgr2=0x7feeb0159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 -- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeb00b3600 msgr2=0x7feeb00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeb00b3600 0x7feeb00c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 -- 172.21.15.26:0/1371568646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb01f1330 con 0x7feeb00cc710 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb4c85640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeaf7fe640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb014f840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feea000b420 tx=0x7feea000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeacff9640 1 -- 172.21.15.26:0/1371568646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0011830 con 0x7feeb00cc710 2024-04-25T13:16:06.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeacff9640 1 -- 172.21.15.26:0/1371568646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea0016070 con 0x7feeb00cc710 2024-04-25T13:16:06.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb01f1610 con 0x7feeb00cc710 2024-04-25T13:16:06.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeacff9640 1 -- 172.21.15.26:0/1371568646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0011c10 con 0x7feeb00cc710 2024-04-25T13:16:06.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.483+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb01f1bd0 con 0x7feeb00cc710 2024-04-25T13:16:06.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.484+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb00c7150 con 0x7feeb00cc710 2024-04-25T13:16:06.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.485+0000 7feeacff9640 1 -- 172.21.15.26:0/1371568646 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feea001b460 con 0x7feeb00cc710 2024-04-25T13:16:06.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.485+0000 7feeacff9640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fee9c06c8f0 0x7fee9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.485+0000 7feeacff9640 1 -- 172.21.15.26:0/1371568646 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7feea008b2a0 con 0x7feeb00cc710 2024-04-25T13:16:06.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.486+0000 7feeaffff640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fee9c06c8f0 0x7fee9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.486+0000 7feeaffff640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fee9c06c8f0 0x7fee9c06edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feea4006fd0 tx=0x7feea4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.489+0000 7feeacff9640 1 -- 172.21.15.26:0/1371568646 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feeb00c7150 con 0x7feeb00cc710 2024-04-25T13:16:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.676+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feeb0068f50 con 0x7feeb00cc710 2024-04-25T13:16:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.676+0000 7feeacff9640 1 -- 172.21.15.26:0/1371568646 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7feea0020020 con 0x7feeb00cc710 2024-04-25T13:16:06.676 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:16:06.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.678+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fee9c06c8f0 msgr2=0x7fee9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fee9c06c8f0 0x7fee9c06edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feea4006fd0 tx=0x7feea4008040 comp rx=0 tx=0).stop 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 msgr2=0x7feeb014f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb014f840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feea000b420 tx=0x7feea000b8e0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 shutdown_connections 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fee9c06c8f0 0x7fee9c06edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeb0154f00 0x7feeb0159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb00cc710 0x7feeb014f840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 --2- 172.21.15.26:0/1371568646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeb00b3600 0x7feeb00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 >> 172.21.15.26:0/1371568646 conn(0x7feeb0068570 msgr2=0x7feeb0072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 shutdown_connections 2024-04-25T13:16:06.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.679+0000 7feeb66e8640 1 -- 172.21.15.26:0/1371568646 wait complete. 2024-04-25T13:16:06.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T13:16:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.791+0000 7f3ddd420640 1 Processor -- start 2024-04-25T13:16:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.791+0000 7f3ddd420640 1 -- start start 2024-04-25T13:16:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3ddd420640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3ddd420640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3dd80b3c00 0x7f3dd80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3ddd420640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd81558c0 con 0x7f3dd80b5450 2024-04-25T13:16:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3ddd420640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd80b4a80 con 0x7f3dd80b3c00 2024-04-25T13:16:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3ddd420640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd815f630 con 0x7f3dd81554e0 2024-04-25T13:16:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dcffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3dd80b3c00 0x7f3dd80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dd77fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3dd80b5450 0x7f3dd80d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46578/0 (socket says 172.21.15.26:46578) 2024-04-25T13:16:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dd77fe640 1 -- 172.21.15.26:0/3172992395 learned_addr learned my addr 172.21.15.26:0/3172992395 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dd6ffd640 1 --2- 172.21.15.26:0/3172992395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dcffff640 1 -- 172.21.15.26:0/3172992395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 msgr2=0x7f3dd815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dcffff640 1 --2- 172.21.15.26:0/3172992395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dcffff640 1 -- 172.21.15.26:0/3172992395 >> v1:172.21.15.26:6789/0 conn(0x7f3dd80b5450 legacy=0x7f3dd80d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dd67fc640 1 -- 172.21.15.26:0/3172992395 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050621729 0 0) 0x7f3dd0001490 con 0x7f3dd80b5450 2024-04-25T13:16:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.792+0000 7f3dcffff640 1 -- 172.21.15.26:0/3172992395 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd80cb8c0 con 0x7f3dd80b3c00 2024-04-25T13:16:06.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.793+0000 7f3dcffff640 1 --2- 172.21.15.26:0/3172992395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd80b4f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00097a0 tx=0x7f3dc002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6769f68b2083d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.793+0000 7f3dd67fc640 1 -- 172.21.15.26:0/3172992395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0037070 con 0x7f3dd80b3c00 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.793+0000 7f3dd67fc640 1 -- 172.21.15.26:0/3172992395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc0032440 con 0x7f3dd80b3c00 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.793+0000 7f3dd67fc640 1 -- 172.21.15.26:0/3172992395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0032810 con 0x7f3dd80b3c00 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 -- 172.21.15.26:0/3172992395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 msgr2=0x7f3dd80b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3172992395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd80b4f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00097a0 tx=0x7f3dc002a210 comp rx=0 tx=0).stop 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 -- 172.21.15.26:0/3172992395 shutdown_connections 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3172992395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd80b4f10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3172992395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 -- 172.21.15.26:0/3172992395 >> 172.21.15.26:0/3172992395 conn(0x7f3dd8074d50 msgr2=0x7f3dd8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 -- 172.21.15.26:0/3172992395 shutdown_connections 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.794+0000 7f3ddd420640 1 -- 172.21.15.26:0/3172992395 wait complete. 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 Processor -- start 2024-04-25T13:16:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 -- start start 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd80b5450 0x7f3dd81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd8159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd80b4430 con 0x7f3dd80b3c00 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd80b4150 con 0x7f3dd80b5450 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.795+0000 7f3ddd420640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd80b4710 con 0x7f3dd81554e0 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd814f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58058/0 (socket says 172.21.15.26:58058) 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 -- 172.21.15.26:0/3462356340 learned_addr learned my addr 172.21.15.26:0/3462356340 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd77fe640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd8159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dcffff640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd80b5450 0x7f3dd81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 -- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 msgr2=0x7f3dd8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd8159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 -- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd80b5450 msgr2=0x7f3dd81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd80b5450 0x7f3dd81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 -- 172.21.15.26:0/3462356340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd814b9b0 con 0x7f3dd80b3c00 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd77fe640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd8159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dcffff640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd80b5450 0x7f3dd81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dd6ffd640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd814f480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d830 tx=0x7f3dc800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dcf7fe640 1 -- 172.21.15.26:0/3462356340 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800b660 con 0x7f3dd80b3c00 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dcf7fe640 1 -- 172.21.15.26:0/3462356340 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc8019070 con 0x7f3dd80b3c00 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd80c8770 con 0x7f3dd80b3c00 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3dcf7fe640 1 -- 172.21.15.26:0/3462356340 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800ba20 con 0x7f3dd80b3c00 2024-04-25T13:16:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.796+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd81f1180 con 0x7f3dd80b3c00 2024-04-25T13:16:06.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.797+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd81f0f70 con 0x7f3dd80b3c00 2024-04-25T13:16:06.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.798+0000 7f3dcf7fe640 1 -- 172.21.15.26:0/3462356340 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dc801e460 con 0x7f3dd80b3c00 2024-04-25T13:16:06.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.798+0000 7f3dcf7fe640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3db806c8f0 0x7f3db806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.798+0000 7f3dcf7fe640 1 -- 172.21.15.26:0/3462356340 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3dc808bdf0 con 0x7f3dd80b3c00 2024-04-25T13:16:06.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.798+0000 7f3dcffff640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3db806c8f0 0x7f3db806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.799+0000 7f3dcffff640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3db806c8f0 0x7f3db806edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0034000 tx=0x7f3dc002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.802+0000 7f3dcf7fe640 1 -- 172.21.15.26:0/3462356340 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dc805a600 con 0x7f3dd80b3c00 2024-04-25T13:16:06.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.988+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3dd8068e40 con 0x7f3dd80b3c00 2024-04-25T13:16:06.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.989+0000 7f3dcf7fe640 1 -- 172.21.15.26:0/3462356340 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f3dc8059f00 con 0x7f3dd80b3c00 2024-04-25T13:16:06.989 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:06.989 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2024-04-25T13:16:06.989 INFO:teuthology.orchestra.run.smithi026.stdout: { 2024-04-25T13:16:06.989 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2024-04-25T13:16:06.989 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2024-04-25T13:16:06.989 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-25T13:16:06.989 INFO:teuthology.orchestra.run.smithi026.stdout:] 2024-04-25T13:16:06.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3db806c8f0 msgr2=0x7f3db806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3db806c8f0 0x7f3db806edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0034000 tx=0x7f3dc002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 msgr2=0x7f3dd814f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd814f480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d830 tx=0x7f3dc800dcf0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 shutdown_connections 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3db806c8f0 0x7f3db806edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3dd81554e0 0x7f3dd8159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd80b5450 0x7f3dd81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 --2- 172.21.15.26:0/3462356340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dd80b3c00 0x7f3dd814f480 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.990+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 >> 172.21.15.26:0/3462356340 conn(0x7f3dd8074d50 msgr2=0x7f3dd8152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.991+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 shutdown_connections 2024-04-25T13:16:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:06.991+0000 7f3ddd420640 1 -- 172.21.15.26:0/3462356340 wait complete. 2024-04-25T13:16:07.001 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T13:16:07.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T13:16:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.106+0000 7f7d87610640 1 Processor -- start 2024-04-25T13:16:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.106+0000 7f7d87610640 1 -- start start 2024-04-25T13:16:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d87610640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7d80155130 0x7f7d8015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d87610640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d800cde80 0x7f7d800c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d87610640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8015e800 con 0x7f7d80155510 2024-04-25T13:16:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d87610640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8015e5d0 con 0x7f7d800cde80 2024-04-25T13:16:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d87610640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8015bfa0 con 0x7f7d80155130 2024-04-25T13:16:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d85bad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d800cde80 0x7f7d800c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d85bad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d800cde80 0x7f7d800c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58062/0 (socket says 172.21.15.26:58062) 2024-04-25T13:16:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d85bad640 1 -- 172.21.15.26:0/2960966114 learned_addr learned my addr 172.21.15.26:0/2960966114 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d853ac640 1 --2- 172.21.15.26:0/2960966114 >> v2:172.21.15.169:3300/0 conn(0x7f7d80155130 0x7f7d8015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d85bad640 1 -- 172.21.15.26:0/2960966114 >> v2:172.21.15.169:3300/0 conn(0x7f7d80155130 msgr2=0x7f7d8015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d85bad640 1 --2- 172.21.15.26:0/2960966114 >> v2:172.21.15.169:3300/0 conn(0x7f7d80155130 0x7f7d8015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d85bad640 1 -- 172.21.15.26:0/2960966114 >> v1:172.21.15.169:6789/0 conn(0x7f7d80155510 legacy=0x7f7d80073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.107+0000 7f7d85bad640 1 -- 172.21.15.26:0/2960966114 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8015eac0 con 0x7f7d800cde80 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.108+0000 7f7d85bad640 1 --2- 172.21.15.26:0/2960966114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800cde80 0x7f7d800c5c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d800741d0 tx=0x7f7d7002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba625dd83677b675 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.108+0000 7f7d7ffff640 1 -- 172.21.15.26:0/2960966114 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d70036070 con 0x7f7d800cde80 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.108+0000 7f7d7ffff640 1 -- 172.21.15.26:0/2960966114 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d70031600 con 0x7f7d800cde80 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.108+0000 7f7d7ffff640 1 -- 172.21.15.26:0/2960966114 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d700319d0 con 0x7f7d800cde80 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 -- 172.21.15.26:0/2960966114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800cde80 msgr2=0x7f7d800c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 --2- 172.21.15.26:0/2960966114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800cde80 0x7f7d800c5c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d800741d0 tx=0x7f7d7002a710 comp rx=0 tx=0).stop 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 -- 172.21.15.26:0/2960966114 shutdown_connections 2024-04-25T13:16:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 --2- 172.21.15.26:0/2960966114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800cde80 0x7f7d800c5c30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 --2- 172.21.15.26:0/2960966114 >> v2:172.21.15.169:3300/0 conn(0x7f7d80155130 0x7f7d8015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 -- 172.21.15.26:0/2960966114 >> 172.21.15.26:0/2960966114 conn(0x7f7d80068360 msgr2=0x7f7d8006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 -- 172.21.15.26:0/2960966114 shutdown_connections 2024-04-25T13:16:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.109+0000 7f7d87610640 1 -- 172.21.15.26:0/2960966114 wait complete. 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.110+0000 7f7d87610640 1 Processor -- start 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.110+0000 7f7d87610640 1 -- start start 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d87610640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d800cde80 0x7f7d801f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d87610640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d80155130 0x7f7d801e6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d87610640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d80155510 0x7f7d801e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d87610640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8015f080 con 0x7f7d80155130 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d87610640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d800c57a0 con 0x7f7d800cde80 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d87610640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8015f360 con 0x7f7d80155510 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d80155130 0x7f7d801e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d80155130 0x7f7d801e6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58066/0 (socket says 172.21.15.26:58066) 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 -- 172.21.15.26:0/2241787292 learned_addr learned my addr 172.21.15.26:0/2241787292 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d853ac640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d800cde80 0x7f7d801f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d85bad640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d80155510 0x7f7d801e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 -- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d80155510 msgr2=0x7f7d801e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d80155510 0x7f7d801e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 -- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d800cde80 msgr2=0x7f7d801f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d800cde80 0x7f7d801f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 -- 172.21.15.26:0/2241787292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d801f2230 con 0x7f7d80155130 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d85bad640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d80155510 0x7f7d801e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d84bab640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d80155130 0x7f7d801e6670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c430 tx=0x7f7d7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d7dffb640 1 -- 172.21.15.26:0/2241787292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74011790 con 0x7f7d80155130 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d7dffb640 1 -- 172.21.15.26:0/2241787292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d74017070 con 0x7f7d80155130 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d801e7350 con 0x7f7d80155130 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.111+0000 7f7d7dffb640 1 -- 172.21.15.26:0/2241787292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74011b70 con 0x7f7d80155130 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.112+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d801e78b0 con 0x7f7d80155130 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.113+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d800b5d30 con 0x7f7d80155130 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.113+0000 7f7d7dffb640 1 -- 172.21.15.26:0/2241787292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d74011d10 con 0x7f7d80155130 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.113+0000 7f7d7dffb640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7d6c06c8f0 0x7f7d6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.113+0000 7f7d7dffb640 1 -- 172.21.15.26:0/2241787292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7d7408b5f0 con 0x7f7d80155130 2024-04-25T13:16:07.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.114+0000 7f7d853ac640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7d6c06c8f0 0x7f7d6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.114+0000 7f7d853ac640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7d6c06c8f0 0x7f7d6c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d78006fd0 tx=0x7f7d78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.118+0000 7f7d7dffb640 1 -- 172.21.15.26:0/2241787292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d74059d70 con 0x7f7d80155130 2024-04-25T13:16:07.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:07.302+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7d800cd580 con 0x7f7d80155130 2024-04-25T13:16:08.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.202+0000 7f7d7dffb640 1 -- 172.21.15.26:0/2241787292 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f7d74059670 con 0x7f7d80155130 2024-04-25T13:16:08.202 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2024-04-25T13:16:08.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.205+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7d6c06c8f0 msgr2=0x7f7d6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7d6c06c8f0 0x7f7d6c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d78006fd0 tx=0x7f7d78008040 comp rx=0 tx=0).stop 2024-04-25T13:16:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d80155130 msgr2=0x7f7d801e6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d80155130 0x7f7d801e6670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c430 tx=0x7f7d7400c8f0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 shutdown_connections 2024-04-25T13:16:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7d6c06c8f0 0x7f7d6c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d80155510 0x7f7d801e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d80155130 0x7f7d801e6670 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 --2- 172.21.15.26:0/2241787292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d800cde80 0x7f7d801f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.206+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 >> 172.21.15.26:0/2241787292 conn(0x7f7d80068360 msgr2=0x7f7d801599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.207+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 shutdown_connections 2024-04-25T13:16:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.207+0000 7f7d87610640 1 -- 172.21.15.26:0/2241787292 wait complete. 2024-04-25T13:16:08.223 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T13:16:08.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.338+0000 7f27154d0640 1 Processor -- start 2024-04-25T13:16:08.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.338+0000 7f27154d0640 1 -- start start 2024-04-25T13:16:08.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.338+0000 7f27154d0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27100c2b30 0x7f271015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.338+0000 7f27154d0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f27100c2f10 0x7f2710154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.338+0000 7f27154d0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27100c25f0 con 0x7f2710068060 2024-04-25T13:16:08.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.338+0000 7f27154d0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f271015c0a0 con 0x7f27100c2b30 2024-04-25T13:16:08.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.338+0000 7f27154d0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f271015e780 con 0x7f27100c2f10 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27100c2b30 0x7f271015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2710068060 0x7f271015ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46590/0 (socket says 172.21.15.26:46590) 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270f7fe640 1 -- 172.21.15.26:0/1504923399 learned_addr learned my addr 172.21.15.26:0/1504923399 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270e7fc640 1 --2- 172.21.15.26:0/1504923399 >> v2:172.21.15.169:3300/0 conn(0x7f27100c2f10 0x7f2710154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270dffb640 1 -- 172.21.15.26:0/1504923399 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388650192 0 0) 0x7f27100c25f0 con 0x7f2710068060 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270dffb640 1 -- 172.21.15.26:0/1504923399 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26f8003520 con 0x7f2710068060 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270effd640 1 -- 172.21.15.26:0/1504923399 >> v2:172.21.15.169:3300/0 conn(0x7f27100c2f10 msgr2=0x7f2710154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270effd640 1 --2- 172.21.15.26:0/1504923399 >> v2:172.21.15.169:3300/0 conn(0x7f27100c2f10 0x7f2710154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270effd640 1 -- 172.21.15.26:0/1504923399 >> v1:172.21.15.26:6789/0 conn(0x7f2710068060 legacy=0x7f271015ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270effd640 1 -- 172.21.15.26:0/1504923399 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271006eba0 con 0x7f27100c2b30 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.339+0000 7f270e7fc640 1 --2- 172.21.15.26:0/1504923399 >> v2:172.21.15.169:3300/0 conn(0x7f27100c2f10 0x7f2710154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f270effd640 1 --2- 172.21.15.26:0/1504923399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f271015bb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27100c9440 tx=0x7f270002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b78dade08fb6a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f270dffb640 1 -- 172.21.15.26:0/1504923399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2700037070 con 0x7f27100c2b30 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f270dffb640 1 -- 172.21.15.26:0/1504923399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2700032440 con 0x7f27100c2b30 2024-04-25T13:16:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f270dffb640 1 -- 172.21.15.26:0/1504923399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27000327f0 con 0x7f27100c2b30 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 -- 172.21.15.26:0/1504923399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 msgr2=0x7f271015bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 --2- 172.21.15.26:0/1504923399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f271015bb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27100c9440 tx=0x7f270002a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 -- 172.21.15.26:0/1504923399 shutdown_connections 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 --2- 172.21.15.26:0/1504923399 >> v2:172.21.15.169:3300/0 conn(0x7f27100c2f10 0x7f2710154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 --2- 172.21.15.26:0/1504923399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f271015bb60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 -- 172.21.15.26:0/1504923399 >> 172.21.15.26:0/1504923399 conn(0x7f271006f3d0 msgr2=0x7f271006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 -- 172.21.15.26:0/1504923399 shutdown_connections 2024-04-25T13:16:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.340+0000 7f27154d0640 1 -- 172.21.15.26:0/1504923399 wait complete. 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 Processor -- start 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 -- start start 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2710068060 0x7f271015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f27100735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27100c2f10 0x7f27100cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f27100c3510 con 0x7f27100c2b30 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27100c2310 con 0x7f27100c2f10 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.342+0000 7f27154d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f271006e840 con 0x7f2710068060 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f27100735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f27100735b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58092/0 (socket says 172.21.15.26:58092) 2024-04-25T13:16:08.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 -- 172.21.15.26:0/2628920117 learned_addr learned my addr 172.21.15.26:0/2628920117 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270f7fe640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27100c2f10 0x7f27100cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270effd640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2710068060 0x7f271015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 -- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2710068060 msgr2=0x7f271015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2710068060 0x7f271015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 -- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27100c2f10 msgr2=0x7f27100cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27100c2f10 0x7f27100cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 -- 172.21.15.26:0/2628920117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27101f1750 con 0x7f27100c2b30 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270f7fe640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27100c2f10 0x7f27100cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f270e7fc640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f27100735b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f270400e810 tx=0x7f270400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f26f77fe640 1 -- 172.21.15.26:0/2628920117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270400f040 con 0x7f27100c2b30 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f26f77fe640 1 -- 172.21.15.26:0/2628920117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2704004030 con 0x7f27100c2b30 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27100ccc30 con 0x7f27100c2b30 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f26f77fe640 1 -- 172.21.15.26:0/2628920117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2704004400 con 0x7f27100c2b30 2024-04-25T13:16:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.343+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27100cc950 con 0x7f27100c2b30 2024-04-25T13:16:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.344+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2710068e40 con 0x7f27100c2b30 2024-04-25T13:16:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.345+0000 7f26f77fe640 1 -- 172.21.15.26:0/2628920117 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f270400c6d0 con 0x7f27100c2b30 2024-04-25T13:16:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.345+0000 7f26f77fe640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f26fc06c8f0 0x7f26fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.345+0000 7f26f77fe640 1 -- 172.21.15.26:0/2628920117 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f270408b660 con 0x7f27100c2b30 2024-04-25T13:16:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.345+0000 7f270effd640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f26fc06c8f0 0x7f26fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.346+0000 7f270effd640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f26fc06c8f0 0x7f26fc06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2700034000 tx=0x7f270002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:08.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.350+0000 7f26f77fe640 1 -- 172.21.15.26:0/2628920117 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2704017020 con 0x7f27100c2b30 2024-04-25T13:16:08.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:08.534+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f271015c780 con 0x7f27100c2b30 2024-04-25T13:16:09.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.207+0000 7f26f77fe640 1 -- 172.21.15.26:0/2628920117 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f2704059590 con 0x7f27100c2b30 2024-04-25T13:16:09.207 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2024-04-25T13:16:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f26fc06c8f0 msgr2=0x7f26fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f26fc06c8f0 0x7f26fc06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2700034000 tx=0x7f270002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 msgr2=0x7f27100735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f27100735b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f270400e810 tx=0x7f270400ecd0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 shutdown_connections 2024-04-25T13:16:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f26fc06c8f0 0x7f26fc06edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27100c2f10 0x7f27100cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27100c2b30 0x7f27100735b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 --2- 172.21.15.26:0/2628920117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2710068060 0x7f271015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.211+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 >> 172.21.15.26:0/2628920117 conn(0x7f271006f3d0 msgr2=0x7f2710152030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.212+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 shutdown_connections 2024-04-25T13:16:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.212+0000 7f27154d0640 1 -- 172.21.15.26:0/2628920117 wait complete. 2024-04-25T13:16:09.239 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T13:16:09.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.348+0000 7f0c79fb4640 1 Processor -- start 2024-04-25T13:16:09.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.348+0000 7f0c79fb4640 1 -- start start 2024-04-25T13:16:09.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c79fb4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0c741553c0 0x7f0c7415edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c79fb4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c740c5c80 con 0x7f0c7415b070 2024-04-25T13:16:09.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c79fb4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c7415b5d0 con 0x7f0c7415f310 2024-04-25T13:16:09.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c79fb4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7415e660 con 0x7f0c741553c0 2024-04-25T13:16:09.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c73fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0c7415b070 0x7f0c740d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46596/0 (socket says 172.21.15.26:46596) 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c73fff640 1 -- 172.21.15.26:0/608881469 learned_addr learned my addr 172.21.15.26:0/608881469 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c737fe640 1 --2- 172.21.15.26:0/608881469 >> v2:172.21.15.169:3300/0 conn(0x7f0c741553c0 0x7f0c7415edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.349+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458054820 0 0) 0x7f0c740c5c80 con 0x7f0c7415b070 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c5c003520 con 0x7f0c7415b070 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3819325538 0 0) 0x7f0c5c003520 con 0x7f0c7415b070 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 >> v2:172.21.15.169:3300/0 conn(0x7f0c741553c0 msgr2=0x7f0c7415edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 --2- 172.21.15.26:0/608881469 >> v2:172.21.15.169:3300/0 conn(0x7f0c741553c0 0x7f0c7415edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 >> v1:172.21.15.169:6789/0 conn(0x7f0c7415f310 legacy=0x7f0c740cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7415b8b0 con 0x7f0c7415b070 2024-04-25T13:16:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f0c6c0019f0 con 0x7f0c7415b070 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 >> v1:172.21.15.26:6789/0 conn(0x7f0c7415b070 legacy=0x7f0c740d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c5c0039b0 0x7f0c5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c5c0051c0 0x7f0c5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7415e660 con 0x7f0c5c004800 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c00c060 con 0x7f0c5c0039b0 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c5c00c260 con 0x7f0c5c0051c0 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c737fe640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c5c0039b0 0x7f0c5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c73fff640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c5c0051c0 0x7f0c5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c72ffd640 1 -- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c5c0051c0 msgr2=0x7f0c5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c5c0051c0 0x7f0c5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c72ffd640 1 -- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c5c0039b0 msgr2=0x7f0c5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c5c0039b0 0x7f0c5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c72ffd640 1 -- 172.21.15.26:0/608881469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c003520 con 0x7f0c5c004800 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.350+0000 7f0c73fff640 1 -- 172.21.15.26:0/608881469 reap_dead start 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.351+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c5c004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c68001770 tx=0x7f0c5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f4254645a6458a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.351+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680013c0 con 0x7f0c5c004800 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.351+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c680052d0 con 0x7f0c5c004800 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.351+0000 7f0c727fc640 1 -- 172.21.15.26:0/608881469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6802a8c0 con 0x7f0c5c004800 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.352+0000 7f0c79fb4640 1 -- 172.21.15.26:0/608881469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 msgr2=0x7f0c5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.352+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c5c004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c68001770 tx=0x7f0c5c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.352+0000 7f0c79fb4640 1 -- 172.21.15.26:0/608881469 shutdown_connections 2024-04-25T13:16:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.352+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/608881469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c5c004c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.352+0000 7f0c79fb4640 1 -- 172.21.15.26:0/608881469 >> 172.21.15.26:0/608881469 conn(0x7f0c74072360 msgr2=0x7f0c74074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.352+0000 7f0c79fb4640 1 -- 172.21.15.26:0/608881469 shutdown_connections 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.352+0000 7f0c79fb4640 1 -- 172.21.15.26:0/608881469 wait complete. 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.353+0000 7f0c79fb4640 1 Processor -- start 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.353+0000 7f0c79fb4640 1 -- start start 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c79fb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c7415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c79fb4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c741f2580 0x7f0c741e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c79fb4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7414b0d0 0x7f0c7414b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c79fb4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7415be70 con 0x7f0c5c004800 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c79fb4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741557a0 con 0x7f0c741f2580 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c79fb4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7415e8b0 con 0x7f0c7414b0d0 2024-04-25T13:16:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c7415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c7415dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58116/0 (socket says 172.21.15.26:58116) 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 -- 172.21.15.26:0/2257261921 learned_addr learned my addr 172.21.15.26:0/2257261921 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c73fff640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7414b0d0 0x7f0c7414b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c741f2580 0x7f0c741e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 -- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7414b0d0 msgr2=0x7f0c7414b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7414b0d0 0x7f0c7414b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 -- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c741f2580 msgr2=0x7f0c741e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c741f2580 0x7f0c741e63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 -- 172.21.15.26:0/2257261921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c741e5df0 con 0x7f0c5c004800 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c741f2580 0x7f0c741e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.354+0000 7f0c737fe640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c7415dd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c640119b0 tx=0x7f0c64011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.355+0000 7f0c5bfff640 1 -- 172.21.15.26:0/2257261921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400faf0 con 0x7f0c5c004800 2024-04-25T13:16:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.355+0000 7f0c5bfff640 1 -- 172.21.15.26:0/2257261921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6400fc90 con 0x7f0c5c004800 2024-04-25T13:16:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.355+0000 7f0c5bfff640 1 -- 172.21.15.26:0/2257261921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64014440 con 0x7f0c5c004800 2024-04-25T13:16:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.355+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7415cc40 con 0x7f0c5c004800 2024-04-25T13:16:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.355+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c741e49f0 con 0x7f0c5c004800 2024-04-25T13:16:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.356+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c74068f50 con 0x7f0c5c004800 2024-04-25T13:16:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.356+0000 7f0c5bfff640 1 -- 172.21.15.26:0/2257261921 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c64012040 con 0x7f0c5c004800 2024-04-25T13:16:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.357+0000 7f0c5bfff640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0c6006c8f0 0x7f0c6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.357+0000 7f0c5bfff640 1 -- 172.21.15.26:0/2257261921 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f0c6408c100 con 0x7f0c5c004800 2024-04-25T13:16:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.357+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0c6006c8f0 0x7f0c6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.357+0000 7f0c72ffd640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0c6006c8f0 0x7f0c6006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c68032000 tx=0x7f0c6802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.361+0000 7f0c5bfff640 1 -- 172.21.15.26:0/2257261921 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c64019030 con 0x7f0c5c004800 2024-04-25T13:16:09.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:09.584+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0c74159480 con 0x7f0c5c004800 2024-04-25T13:16:10.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.222+0000 7f0c5bfff640 1 -- 172.21.15.26:0/2257261921 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f0c6405a620 con 0x7f0c5c004800 2024-04-25T13:16:10.222 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T13:16:10.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.228+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0c6006c8f0 msgr2=0x7f0c6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:10.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.228+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0c6006c8f0 0x7f0c6006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c68032000 tx=0x7f0c6802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:10.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.228+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 msgr2=0x7f0c7415dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:10.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.228+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c7415dd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c640119b0 tx=0x7f0c64011e70 comp rx=0 tx=0).stop 2024-04-25T13:16:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 shutdown_connections 2024-04-25T13:16:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0c6006c8f0 0x7f0c6006edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7414b0d0 0x7f0c7414b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c741f2580 0x7f0c741e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 --2- 172.21.15.26:0/2257261921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c5c004800 0x7f0c7415dd60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 >> 172.21.15.26:0/2257261921 conn(0x7f0c74072360 msgr2=0x7f0c7414d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:10.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 shutdown_connections 2024-04-25T13:16:10.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.233+0000 7f0c79fb4640 1 -- 172.21.15.26:0/2257261921 wait complete. 2024-04-25T13:16:10.248 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T13:16:10.248 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T13:16:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.358+0000 7fe9b4f8e640 1 Processor -- start 2024-04-25T13:16:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.358+0000 7fe9b4f8e640 1 -- start start 2024-04-25T13:16:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.358+0000 7fe9b4f8e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 0x7fe9b0072310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.358+0000 7fe9b4f8e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b0072aa0 con 0x7fe9b00708d0 2024-04-25T13:16:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.358+0000 7fe9b4f8e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b0072d80 con 0x7fe9b00704f0 2024-04-25T13:16:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.358+0000 7fe9b4f8e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b0072850 con 0x7fe9b015f400 2024-04-25T13:16:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.358+0000 7fe9a7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe9b00708d0 0x7fe9b00c8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46598/0 (socket says 172.21.15.26:46598) 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9a7fff640 1 -- 172.21.15.26:0/3487080625 learned_addr learned my addr 172.21.15.26:0/3487080625 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9aed9d640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 0x7fe9b0072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375667736 0 0) 0x7fe9b0072aa0 con 0x7fe9b00708d0 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe99c003520 con 0x7fe9b00708d0 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 212596749 0 0) 0x7fe99c003520 con 0x7fe9b00708d0 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 msgr2=0x7fe9b0072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 0x7fe9b0072310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 >> v1:172.21.15.169:6789/0 conn(0x7fe9b00704f0 legacy=0x7fe9b015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b015e920 con 0x7fe9b00708d0 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7fe998001670 con 0x7fe9b00708d0 2024-04-25T13:16:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 >> v1:172.21.15.26:6789/0 conn(0x7fe9b00708d0 legacy=0x7fe9b00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe99c0039e0 0x7fe99c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 0x7fe99c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe99c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0072850 con 0x7fe99c004d40 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c00b9c0 con 0x7fe99c0039e0 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c00bbc0 con 0x7fe9b015f400 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9aed9d640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe99c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9ae59c640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe99c0039e0 0x7fe99c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9a7fff640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 0x7fe99c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9aed9d640 1 -- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 msgr2=0x7fe99c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9aed9d640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b015f400 0x7fe99c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9aed9d640 1 -- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe99c0039e0 msgr2=0x7fe99c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:10.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.359+0000 7fe9aed9d640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe99c0039e0 0x7fe99c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.360+0000 7fe9aed9d640 1 -- 172.21.15.26:0/3487080625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c003520 con 0x7fe99c004d40 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.360+0000 7fe9aed9d640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe99c0051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009f90 tx=0x7fe99c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff4d1ac84108571 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.360+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8009c10 con 0x7fe99c004d40 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.360+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a8036070 con 0x7fe99c004d40 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.360+0000 7fe9add9b640 1 -- 172.21.15.26:0/3487080625 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8031850 con 0x7fe99c004d40 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.361+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/3487080625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 msgr2=0x7fe99c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.361+0000 7fe9b4f8e640 1 --2- 172.21.15.26:0/3487080625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe99c0051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009f90 tx=0x7fe99c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.361+0000 7fe9aed9d640 1 -- 172.21.15.26:0/3487080625 reap_dead start 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.361+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/3487080625 shutdown_connections 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.361+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/3487080625 >> 172.21.15.26:0/3487080625 conn(0x7fe9b006b920 msgr2=0x7fe9b006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:10.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.361+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/3487080625 shutdown_connections 2024-04-25T13:16:10.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.361+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/3487080625 wait complete. 2024-04-25T13:16:10.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.362+0000 7fe9b4f8e640 1 Processor -- start 2024-04-25T13:16:10.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.362+0000 7fe9b4f8e640 1 -- start start 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9b4f8e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe9b015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9b4f8e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b00c73f0 0x7fe9b00c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9b4f8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9b01f0ad0 0x7fe9b01f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9b4f8e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b006fd00 con 0x7fe99c004d40 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9b4f8e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b015eee0 con 0x7fe9b01f0ad0 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9b4f8e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b0072310 con 0x7fe9b00c73f0 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe9b015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe9b015d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58136/0 (socket says 172.21.15.26:58136) 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 -- 172.21.15.26:0/1898258686 learned_addr learned my addr 172.21.15.26:0/1898258686 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9a7fff640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b00c73f0 0x7fe9b00c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9aed9d640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9b01f0ad0 0x7fe9b01f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 -- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b00c73f0 msgr2=0x7fe9b00c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b00c73f0 0x7fe9b00c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 -- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9b01f0ad0 msgr2=0x7fe9b01f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9b01f0ad0 0x7fe9b01f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 -- 172.21.15.26:0/1898258686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b01f1490 con 0x7fe99c004d40 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.363+0000 7fe9ae59c640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe9b015d8a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000f7f0 tx=0x7fe9a000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.364+0000 7fe9a6ffd640 1 -- 172.21.15.26:0/1898258686 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000fea0 con 0x7fe99c004d40 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.364+0000 7fe9a6ffd640 1 -- 172.21.15.26:0/1898258686 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a0018070 con 0x7fe99c004d40 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.364+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b01f4030 con 0x7fe99c004d40 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.364+0000 7fe9a6ffd640 1 -- 172.21.15.26:0/1898258686 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000d6d0 con 0x7fe99c004d40 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.364+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b01f45f0 con 0x7fe99c004d40 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.365+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b0068f50 con 0x7fe99c004d40 2024-04-25T13:16:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.365+0000 7fe9a6ffd640 1 -- 172.21.15.26:0/1898258686 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9a000d870 con 0x7fe99c004d40 2024-04-25T13:16:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.365+0000 7fe9a6ffd640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe99006c8f0 0x7fe99006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.366+0000 7fe9a6ffd640 1 -- 172.21.15.26:0/1898258686 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fe9a008bb90 con 0x7fe99c004d40 2024-04-25T13:16:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.366+0000 7fe9a7fff640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe99006c8f0 0x7fe99006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.366+0000 7fe9a7fff640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe99006c8f0 0x7fe99006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9b015d380 tx=0x7fe998009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.370+0000 7fe9a6ffd640 1 -- 172.21.15.26:0/1898258686 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9b01f1490 con 0x7fe99c004d40 2024-04-25T13:16:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:10.566+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fe9b014ea20 con 0x7fe99c004d40 2024-04-25T13:16:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.218+0000 7fe9a6ffd640 1 -- 172.21.15.26:0/1898258686 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fe9a001a310 con 0x7fe99c004d40 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe99006c8f0 msgr2=0x7fe99006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe99006c8f0 0x7fe99006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9b015d380 tx=0x7fe998009040 comp rx=0 tx=0).stop 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 msgr2=0x7fe9b015d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe9b015d8a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000f7f0 tx=0x7fe9a000fcb0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 shutdown_connections 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe99006c8f0 0x7fe99006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9b01f0ad0 0x7fe9b01f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9b00c73f0 0x7fe9b00c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 --2- 172.21.15.26:0/1898258686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c004d40 0x7fe9b015d8a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 >> 172.21.15.26:0/1898258686 conn(0x7fe9b006b920 msgr2=0x7fe9b0152350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 shutdown_connections 2024-04-25T13:16:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.221+0000 7fe9b4f8e640 1 -- 172.21.15.26:0/1898258686 wait complete. 2024-04-25T13:16:11.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T13:16:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.350+0000 7f1121210640 1 Processor -- start 2024-04-25T13:16:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.350+0000 7f1121210640 1 -- start start 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f1121210640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c1552c0 0x7f111c15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f1121210640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f111c0c7c40 0x7f111c0d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f1121210640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c0ccf60 con 0x7f111c0d0d10 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f1121210640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f111c0ce110 con 0x7f111c0c7c40 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f1121210640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f111c0cd220 con 0x7f111c1552c0 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111a59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f111c0c7c40 0x7f111c0d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111a59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f111c0c7c40 0x7f111c0d07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58138/0 (socket says 172.21.15.26:58138) 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111a59c640 1 -- 172.21.15.26:0/3040550416 learned_addr learned my addr 172.21.15.26:0/3040550416 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111ad9d640 1 --2- 172.21.15.26:0/3040550416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c1552c0 0x7f111c15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111a59c640 1 -- 172.21.15.26:0/3040550416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c1552c0 msgr2=0x7f111c15bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111a59c640 1 --2- 172.21.15.26:0/3040550416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c1552c0 0x7f111c15bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111a59c640 1 -- 172.21.15.26:0/3040550416 >> v1:172.21.15.169:6789/0 conn(0x7f111c0d0d10 legacy=0x7f111c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.351+0000 7f111a59c640 1 -- 172.21.15.26:0/3040550416 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c0cd500 con 0x7f111c0c7c40 2024-04-25T13:16:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.352+0000 7f111a59c640 1 --2- 172.21.15.26:0/3040550416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0c7c40 0x7f111c0d07d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1104009850 tx=0x7f110402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440380f073ffa362 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.352+0000 7f1119d9b640 1 -- 172.21.15.26:0/3040550416 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104004030 con 0x7f111c0c7c40 2024-04-25T13:16:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.352+0000 7f1119d9b640 1 -- 172.21.15.26:0/3040550416 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11040041d0 con 0x7f111c0c7c40 2024-04-25T13:16:11.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.352+0000 7f1119d9b640 1 -- 172.21.15.26:0/3040550416 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104003610 con 0x7f111c0c7c40 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 -- 172.21.15.26:0/3040550416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0c7c40 msgr2=0x7f111c0d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 --2- 172.21.15.26:0/3040550416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0c7c40 0x7f111c0d07d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1104009850 tx=0x7f110402a270 comp rx=0 tx=0).stop 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 -- 172.21.15.26:0/3040550416 shutdown_connections 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 --2- 172.21.15.26:0/3040550416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0c7c40 0x7f111c0d07d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 --2- 172.21.15.26:0/3040550416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c1552c0 0x7f111c15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 -- 172.21.15.26:0/3040550416 >> 172.21.15.26:0/3040550416 conn(0x7f111c074d50 msgr2=0x7f111c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 -- 172.21.15.26:0/3040550416 shutdown_connections 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.353+0000 7f1121210640 1 -- 172.21.15.26:0/3040550416 wait complete. 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.354+0000 7f1121210640 1 Processor -- start 2024-04-25T13:16:11.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.354+0000 7f1121210640 1 -- start start 2024-04-25T13:16:11.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f1121210640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c0c7c40 0x7f111c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f1121210640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0d0d10 0x7f111c0beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f1121210640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f111c1552c0 0x7f111c0c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f1121210640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f111c0cdda0 con 0x7f111c0d0d10 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f1121210640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f111c0cdac0 con 0x7f111c1552c0 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f1121210640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f111c1556a0 con 0x7f111c0c7c40 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0d0d10 0x7f111c0beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0d0d10 0x7f111c0beda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58148/0 (socket says 172.21.15.26:58148) 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 -- 172.21.15.26:0/854360228 learned_addr learned my addr 172.21.15.26:0/854360228 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111b59e640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f111c1552c0 0x7f111c0c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111ad9d640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c0c7c40 0x7f111c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 -- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c0c7c40 msgr2=0x7f111c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c0c7c40 0x7f111c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 -- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f111c1552c0 msgr2=0x7f111c0c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f111c1552c0 0x7f111c0c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 -- 172.21.15.26:0/854360228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c15b270 con 0x7f111c0d0d10 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111ad9d640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c0c7c40 0x7f111c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111b59e640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f111c1552c0 0x7f111c0c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.355+0000 7f111a59c640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0d0d10 0x7f111c0beda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1104034040 tx=0x7f11040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.356+0000 7f11137fe640 1 -- 172.21.15.26:0/854360228 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104041020 con 0x7f111c0d0d10 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.356+0000 7f11137fe640 1 -- 172.21.15.26:0/854360228 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1104003c50 con 0x7f111c0d0d10 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.356+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c0be960 con 0x7f111c0d0d10 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.356+0000 7f11137fe640 1 -- 172.21.15.26:0/854360228 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104004030 con 0x7f111c0d0d10 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.356+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c0be680 con 0x7f111c0d0d10 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.357+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c068d30 con 0x7f111c0d0d10 2024-04-25T13:16:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.357+0000 7f11137fe640 1 -- 172.21.15.26:0/854360228 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1104044020 con 0x7f111c0d0d10 2024-04-25T13:16:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.358+0000 7f11137fe640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f10fc06c8f0 0x7f10fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.358+0000 7f11137fe640 1 -- 172.21.15.26:0/854360228 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f11040ac830 con 0x7f111c0d0d10 2024-04-25T13:16:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.358+0000 7f111ad9d640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f10fc06c8f0 0x7f10fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.358+0000 7f111ad9d640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f10fc06c8f0 0x7f10fc06edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1114006fd0 tx=0x7f1114008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:11.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.362+0000 7f11137fe640 1 -- 172.21.15.26:0/854360228 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f110404b030 con 0x7f111c0d0d10 2024-04-25T13:16:11.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:11.548+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f111c156f00 con 0x7f111c0d0d10 2024-04-25T13:16:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.229+0000 7f11137fe640 1 -- 172.21.15.26:0/854360228 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f110407ab30 con 0x7f111c0d0d10 2024-04-25T13:16:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data_ec' created 2024-04-25T13:16:13.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f10fc06c8f0 msgr2=0x7f10fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f10fc06c8f0 0x7f10fc06edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1114006fd0 tx=0x7f1114008040 comp rx=0 tx=0).stop 2024-04-25T13:16:13.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0d0d10 msgr2=0x7f111c0beda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0d0d10 0x7f111c0beda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1104034040 tx=0x7f11040046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 shutdown_connections 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f10fc06c8f0 0x7f10fc06edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f111c1552c0 0x7f111c0c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f111c0d0d10 0x7f111c0beda0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 --2- 172.21.15.26:0/854360228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f111c0c7c40 0x7f111c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 >> 172.21.15.26:0/854360228 conn(0x7f111c074d50 msgr2=0x7f111c0c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.233+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 shutdown_connections 2024-04-25T13:16:13.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.234+0000 7f1121210640 1 -- 172.21.15.26:0/854360228 wait complete. 2024-04-25T13:16:13.251 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T13:16:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.358+0000 7f42d5f76640 1 Processor -- start 2024-04-25T13:16:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.358+0000 7f42d5f76640 1 -- start start 2024-04-25T13:16:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42d5f76640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f42d015e9a0 0x7f42d015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42d5f76640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d015f350 con 0x7f42d0155200 2024-04-25T13:16:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42d5f76640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d00caf90 con 0x7f42d00c9cd0 2024-04-25T13:16:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42d5f76640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f42d006c490 con 0x7f42d015e9a0 2024-04-25T13:16:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42cf7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f42d0155200 0x7f42d00cb8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46604/0 (socket says 172.21.15.26:46604) 2024-04-25T13:16:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42cf7fe640 1 -- 172.21.15.26:0/867745990 learned_addr learned my addr 172.21.15.26:0/867745990 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835820388 0 0) 0x7f42d015f350 con 0x7f42d0155200 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b8003520 con 0x7f42d0155200 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42cffff640 1 --2- 172.21.15.26:0/867745990 >> v2:172.21.15.169:3300/0 conn(0x7f42d015e9a0 0x7f42d015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2811266411 0 0) 0x7f42b8003520 con 0x7f42d0155200 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 >> v2:172.21.15.169:3300/0 conn(0x7f42d015e9a0 msgr2=0x7f42d015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42ce7fc640 1 --2- 172.21.15.26:0/867745990 >> v2:172.21.15.169:3300/0 conn(0x7f42d015e9a0 0x7f42d015ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 >> v1:172.21.15.169:6789/0 conn(0x7f42d00c9cd0 legacy=0x7f42d006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.359+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d00ca410 con 0x7f42d0155200 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f42c0001670 con 0x7f42d0155200 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 >> v1:172.21.15.26:6789/0 conn(0x7f42d0155200 legacy=0x7f42d00cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42b80039b0 0x7f42b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42b80051c0 0x7f42b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f42b800c040 con 0x7f42b8004800 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42b800c1f0 con 0x7f42b80039b0 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42b800c3f0 con 0x7f42b80051c0 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ceffd640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42cf7fe640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42b80039b0 0x7f42b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42cffff640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42b80051c0 0x7f42b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ceffd640 1 -- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42b80051c0 msgr2=0x7f42b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ceffd640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42b80051c0 0x7f42b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ceffd640 1 -- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42b80039b0 msgr2=0x7f42b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ceffd640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42b80039b0 0x7f42b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42ceffd640 1 -- 172.21.15.26:0/867745990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b8003520 con 0x7f42b8004800 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.360+0000 7f42cffff640 1 -- 172.21.15.26:0/867745990 reap_dead start 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42ceffd640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42b8004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001750 tx=0x7f42b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5348cdc5d4592943 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4001370 con 0x7f42b8004800 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c40052d0 con 0x7f42b8004800 2024-04-25T13:16:13.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42ce7fc640 1 -- 172.21.15.26:0/867745990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c402abc0 con 0x7f42b8004800 2024-04-25T13:16:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42d5f76640 1 -- 172.21.15.26:0/867745990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 msgr2=0x7f42b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42d5f76640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42b8004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001750 tx=0x7f42b8005830 comp rx=0 tx=0).stop 2024-04-25T13:16:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42d5f76640 1 -- 172.21.15.26:0/867745990 shutdown_connections 2024-04-25T13:16:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42d5f76640 1 --2- 172.21.15.26:0/867745990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42b8004c80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42d5f76640 1 -- 172.21.15.26:0/867745990 >> 172.21.15.26:0/867745990 conn(0x7f42d006f670 msgr2=0x7f42d0070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42d5f76640 1 -- 172.21.15.26:0/867745990 shutdown_connections 2024-04-25T13:16:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.361+0000 7f42d5f76640 1 -- 172.21.15.26:0/867745990 wait complete. 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 Processor -- start 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 -- start start 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42d014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d0147850 0x7f42d01e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d01e4640 0x7f42d0144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00cacb0 con 0x7f42b8004800 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00ca9d0 con 0x7f42d0147850 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.363+0000 7f42d5f76640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42d01555e0 con 0x7f42d01e4640 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42d014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42d014f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58160/0 (socket says 172.21.15.26:58160) 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 -- 172.21.15.26:0/4170013242 learned_addr learned my addr 172.21.15.26:0/4170013242 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42ceffd640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d0147850 0x7f42d01e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cffff640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d01e4640 0x7f42d0144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 -- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d01e4640 msgr2=0x7f42d0144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d01e4640 0x7f42d0144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 -- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d0147850 msgr2=0x7f42d01e5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d0147850 0x7f42d01e5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 -- 172.21.15.26:0/4170013242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d01e7120 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42ceffd640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d0147850 0x7f42d01e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42cf7fe640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42d014f360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c00073a0 tx=0x7f42c0007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42b7fff640 1 -- 172.21.15.26:0/4170013242 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c001a070 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42b7fff640 1 -- 172.21.15.26:0/4170013242 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c000f8e0 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d01e5a90 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42b7fff640 1 -- 172.21.15.26:0/4170013242 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c000fcb0 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.364+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d01e6050 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.365+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d006da80 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.366+0000 7f42b7fff640 1 -- 172.21.15.26:0/4170013242 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42c001d070 con 0x7f42b8004800 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.366+0000 7f42b7fff640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f42bc06c920 0x7f42bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.366+0000 7f42b7fff640 1 -- 172.21.15.26:0/4170013242 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f42c008b700 con 0x7f42b8004800 2024-04-25T13:16:13.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.366+0000 7f42ceffd640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f42bc06c920 0x7f42bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.367+0000 7f42ceffd640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f42bc06c920 0x7f42bc06ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42c4032000 tx=0x7f42c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.371+0000 7f42b7fff640 1 -- 172.21.15.26:0/4170013242 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42c0059810 con 0x7f42b8004800 2024-04-25T13:16:13.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:13.553+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f42d00c9770 con 0x7f42b8004800 2024-04-25T13:16:14.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.235+0000 7f42b7fff640 1 -- 172.21.15.26:0/4170013242 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f42c0059110 con 0x7f42b8004800 2024-04-25T13:16:14.235 INFO:teuthology.orchestra.run.smithi026.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T13:16:14.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f42bc06c920 msgr2=0x7f42bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f42bc06c920 0x7f42bc06ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42c4032000 tx=0x7f42c402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:14.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 msgr2=0x7f42d014f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42d014f360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c00073a0 tx=0x7f42c0007860 comp rx=0 tx=0).stop 2024-04-25T13:16:14.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 shutdown_connections 2024-04-25T13:16:14.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f42bc06c920 0x7f42bc06ede0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d01e4640 0x7f42d0144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d0147850 0x7f42d01e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 --2- 172.21.15.26:0/4170013242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42b8004800 0x7f42d014f360 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.239+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 >> 172.21.15.26:0/4170013242 conn(0x7f42d006f670 msgr2=0x7f42d015efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.240+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 shutdown_connections 2024-04-25T13:16:14.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.241+0000 7f42d5f76640 1 -- 172.21.15.26:0/4170013242 wait complete. 2024-04-25T13:16:14.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T13:16:14.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.376+0000 7f6590dbf640 1 Processor -- start 2024-04-25T13:16:14.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.376+0000 7f6590dbf640 1 -- start start 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f6590dbf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f658c1553c0 0x7f658c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f6590dbf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f658c15f310 0x7f658c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f6590dbf640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f658c0c5c80 con 0x7f658c15b070 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f6590dbf640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f658c15e660 con 0x7f658c1553c0 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f6590dbf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f658c1557a0 con 0x7f658c15f310 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f658a59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f658c1553c0 0x7f658c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f658ad9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f658c15b070 0x7f658c0d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52052/0 (socket says 172.21.15.26:52052) 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f658ad9d640 1 -- 172.21.15.26:0/681111781 learned_addr learned my addr 172.21.15.26:0/681111781 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f6583fff640 1 --2- 172.21.15.26:0/681111781 >> v2:172.21.15.169:3300/0 conn(0x7f658c15f310 0x7f658c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f658a59c640 1 -- 172.21.15.26:0/681111781 >> v2:172.21.15.169:3300/0 conn(0x7f658c15f310 msgr2=0x7f658c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f658a59c640 1 --2- 172.21.15.26:0/681111781 >> v2:172.21.15.169:3300/0 conn(0x7f658c15f310 0x7f658c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f658a59c640 1 -- 172.21.15.26:0/681111781 >> v1:172.21.15.26:6789/0 conn(0x7f658c15b070 legacy=0x7f658c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.377+0000 7f658a59c640 1 -- 172.21.15.26:0/681111781 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c15b5d0 con 0x7f658c1553c0 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f658a59c640 1 --2- 172.21.15.26:0/681111781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c1553c0 0x7f658c15edd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f658c08ea60 tx=0x7f657c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9a5cb518101b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6589d9b640 1 -- 172.21.15.26:0/681111781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c037070 con 0x7f658c1553c0 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6589d9b640 1 -- 172.21.15.26:0/681111781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657c032440 con 0x7f658c1553c0 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6589d9b640 1 -- 172.21.15.26:0/681111781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c032810 con 0x7f658c1553c0 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6590dbf640 1 -- 172.21.15.26:0/681111781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c1553c0 msgr2=0x7f658c15edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6590dbf640 1 --2- 172.21.15.26:0/681111781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c1553c0 0x7f658c15edd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f658c08ea60 tx=0x7f657c02a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6590dbf640 1 -- 172.21.15.26:0/681111781 shutdown_connections 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6590dbf640 1 --2- 172.21.15.26:0/681111781 >> v2:172.21.15.169:3300/0 conn(0x7f658c15f310 0x7f658c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6590dbf640 1 --2- 172.21.15.26:0/681111781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c1553c0 0x7f658c15edd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.378+0000 7f6590dbf640 1 -- 172.21.15.26:0/681111781 >> 172.21.15.26:0/681111781 conn(0x7f658c072360 msgr2=0x7f658c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.379+0000 7f6590dbf640 1 -- 172.21.15.26:0/681111781 shutdown_connections 2024-04-25T13:16:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.379+0000 7f6590dbf640 1 -- 172.21.15.26:0/681111781 wait complete. 2024-04-25T13:16:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.380+0000 7f6590dbf640 1 Processor -- start 2024-04-25T13:16:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.380+0000 7f6590dbf640 1 -- start start 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.380+0000 7f6590dbf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f658c1553c0 0x7f658c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.380+0000 7f6590dbf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f658c15b070 0x7f658c1f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.380+0000 7f6590dbf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c15f310 0x7f658c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.380+0000 7f6590dbf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f658c15be70 con 0x7f658c15f310 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6590dbf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f658c15bb90 con 0x7f658c1553c0 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6590dbf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f658c15e8b0 con 0x7f658c15b070 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c15f310 0x7f658c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c15f310 0x7f658c0cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33518/0 (socket says 172.21.15.26:33518) 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 -- 172.21.15.26:0/4167715679 learned_addr learned my addr 172.21.15.26:0/4167715679 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658a59c640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f658c1553c0 0x7f658c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6583fff640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f658c15b070 0x7f658c1f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 -- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f658c15b070 msgr2=0x7f658c1f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f658c15b070 0x7f658c1f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 -- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f658c1553c0 msgr2=0x7f658c151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f658c1553c0 0x7f658c151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 -- 172.21.15.26:0/4167715679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c151c60 con 0x7f658c15f310 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658a59c640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f658c1553c0 0x7f658c151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f658ad9d640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c15f310 0x7f658c0cc570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f658400cad0 tx=0x7f658400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6582ffd640 1 -- 172.21.15.26:0/4167715679 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584017070 con 0x7f658c15f310 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6582ffd640 1 -- 172.21.15.26:0/4167715679 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658400ac30 con 0x7f658c15f310 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c150770 con 0x7f658c15f310 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6582ffd640 1 -- 172.21.15.26:0/4167715679 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584012620 con 0x7f658c15f310 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.381+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c150cf0 con 0x7f658c15f310 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.382+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c068f50 con 0x7f658c15f310 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.383+0000 7f6582ffd640 1 -- 172.21.15.26:0/4167715679 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f658401a070 con 0x7f658c15f310 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.383+0000 7f6582ffd640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f656c06c8f0 0x7f656c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.383+0000 7f6582ffd640 1 -- 172.21.15.26:0/4167715679 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f658408bb50 con 0x7f658c15f310 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.384+0000 7f658a59c640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f656c06c8f0 0x7f656c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.384+0000 7f658a59c640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f656c06c8f0 0x7f656c06edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f657c034000 tx=0x7f657c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.388+0000 7f6582ffd640 1 -- 172.21.15.26:0/4167715679 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f658400ae20 con 0x7f658c15f310 2024-04-25T13:16:14.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:14.614+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f658c0cc0e0 con 0x7f658c15f310 2024-04-25T13:16:15.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.241+0000 7f6582ffd640 1 -- 172.21.15.26:0/4167715679 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f6584059cf0 con 0x7f658c15f310 2024-04-25T13:16:15.240 INFO:teuthology.orchestra.run.smithi026.stderr:added data pool 4 to fsmap 2024-04-25T13:16:15.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.243+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f656c06c8f0 msgr2=0x7f656c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.243+0000 7f6590dbf640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f656c06c8f0 0x7f656c06edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f657c034000 tx=0x7f657c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.243+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c15f310 msgr2=0x7f658c0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.243+0000 7f6590dbf640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c15f310 0x7f658c0cc570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f658400cad0 tx=0x7f658400cf90 comp rx=0 tx=0).stop 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 shutdown_connections 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f656c06c8f0 0x7f656c06edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658c15f310 0x7f658c0cc570 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f658c15b070 0x7f658c1f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 --2- 172.21.15.26:0/4167715679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f658c1553c0 0x7f658c151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 >> 172.21.15.26:0/4167715679 conn(0x7f658c072360 msgr2=0x7f658c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 shutdown_connections 2024-04-25T13:16:15.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.244+0000 7f6590dbf640 1 -- 172.21.15.26:0/4167715679 wait complete. 2024-04-25T13:16:15.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:15.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.364+0000 7f2e1fa7c640 1 Processor -- start 2024-04-25T13:16:15.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.364+0000 7f2e1fa7c640 1 -- start start 2024-04-25T13:16:15.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1fa7c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 0x7f2e180b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1fa7c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2e180b5450 0x7f2e180d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1fa7c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e181558c0 con 0x7f2e181554e0 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1fa7c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2e180b4a80 con 0x7f2e180b5450 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1fa7c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2e180cb8c0 con 0x7f2e180b3c00 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1d818640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e181554e0 0x7f2e1815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52068/0 (socket says 172.21.15.26:52068) 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1d818640 1 -- 172.21.15.26:0/3585552009 learned_addr learned my addr 172.21.15.26:0/3585552009 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366359366 0 0) 0x7f2e14001110 con 0x7f2e181554e0 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1d017640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 0x7f2e180b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e04003520 con 0x7f2e181554e0 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1e019640 1 --2- 172.21.15.26:0/3585552009 >> v2:172.21.15.169:3300/0 conn(0x7f2e180b5450 0x7f2e180d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4168765286 0 0) 0x7f2e04003520 con 0x7f2e181554e0 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 msgr2=0x7f2e180b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 0x7f2e180b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 >> v2:172.21.15.169:3300/0 conn(0x7f2e180b5450 msgr2=0x7f2e180d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 --2- 172.21.15.26:0/3585552009 >> v2:172.21.15.169:3300/0 conn(0x7f2e180b5450 0x7f2e180d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e180cbba0 con 0x7f2e181554e0 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.365+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f2e14001840 con 0x7f2e181554e0 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 >> v1:172.21.15.26:6789/0 conn(0x7f2e181554e0 legacy=0x7f2e1815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1c816640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e040039b0 0x7f2e04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1c816640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004800 0x7f2e04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1c816640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 0x7f2e040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180b4a80 con 0x7f2e04004800 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180cb8c0 con 0x7f2e040039b0 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0400b9f0 con 0x7f2e180b3c00 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1d017640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004800 0x7f2e04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1d818640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e040039b0 0x7f2e04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1e019640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 0x7f2e040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1d017640 1 -- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 msgr2=0x7f2e040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1d017640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e180b3c00 0x7f2e040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1d017640 1 -- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e040039b0 msgr2=0x7f2e04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1d017640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e040039b0 0x7f2e04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.366+0000 7f2e1d017640 1 -- 172.21.15.26:0/3585552009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e04003520 con 0x7f2e04004800 2024-04-25T13:16:15.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1d017640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004800 0x7f2e04004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009ac0 tx=0x7f2e04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f30e7216a6a4c03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08036070 con 0x7f2e04004800 2024-04-25T13:16:15.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08031400 con 0x7f2e04004800 2024-04-25T13:16:15.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1c816640 1 -- 172.21.15.26:0/3585552009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08009690 con 0x7f2e04004800 2024-04-25T13:16:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/3585552009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004800 msgr2=0x7f2e04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1fa7c640 1 --2- 172.21.15.26:0/3585552009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e04004800 0x7f2e04004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009ac0 tx=0x7f2e04005830 comp rx=0 tx=0).stop 2024-04-25T13:16:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1e019640 1 -- 172.21.15.26:0/3585552009 reap_dead start 2024-04-25T13:16:15.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/3585552009 shutdown_connections 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/3585552009 >> 172.21.15.26:0/3585552009 conn(0x7f2e18074d50 msgr2=0x7f2e18075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/3585552009 shutdown_connections 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.367+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/3585552009 wait complete. 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 Processor -- start 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 -- start start 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e04004800 0x7f2e18154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1815b600 0x7f2e181f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e1815ba40 0x7f2e181f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180b4710 con 0x7f2e1815b600 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180b4430 con 0x7f2e04004800 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.369+0000 7f2e1fa7c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2e180b3580 con 0x7f2e1815ba40 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1815b600 0x7f2e181f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1815b600 0x7f2e181f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33540/0 (socket says 172.21.15.26:33540) 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 -- 172.21.15.26:0/2794980817 learned_addr learned my addr 172.21.15.26:0/2794980817 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d818640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e04004800 0x7f2e18154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1e019640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e1815ba40 0x7f2e181f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 -- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e1815ba40 msgr2=0x7f2e181f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e1815ba40 0x7f2e181f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 -- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e04004800 msgr2=0x7f2e18154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e04004800 0x7f2e18154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 -- 172.21.15.26:0/2794980817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1815bf20 con 0x7f2e1815b600 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1d017640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1815b600 0x7f2e181f4440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e08034040 tx=0x7f2e08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/2794980817 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08040020 con 0x7f2e1815b600 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/2794980817 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08003bc0 con 0x7f2e1815b600 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e181f0f60 con 0x7f2e1815b600 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/2794980817 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08036040 con 0x7f2e1815b600 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.370+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e181f1520 con 0x7f2e1815b600 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.371+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e18068e40 con 0x7f2e1815b600 2024-04-25T13:16:15.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.372+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/2794980817 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e08043020 con 0x7f2e1815b600 2024-04-25T13:16:15.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.372+0000 7f2e0e7fc640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2dfc06c8f0 0x7f2dfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.372+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/2794980817 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2e080ac2d0 con 0x7f2e1815b600 2024-04-25T13:16:15.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.372+0000 7f2e1d818640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2dfc06c8f0 0x7f2dfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.373+0000 7f2e1d818640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2dfc06c8f0 0x7f2dfc06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007fd0 tx=0x7f2e140079f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.377+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/2794980817 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e0804a030 con 0x7f2e1815b600 2024-04-25T13:16:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.601+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e180cca20 con 0x7f2e1815b600 2024-04-25T13:16:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.602+0000 7f2e0e7fc640 1 -- 172.21.15.26:0/2794980817 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6823 (secure 0 0 0) 0x7f2e080044e0 con 0x7f2e1815b600 2024-04-25T13:16:15.602 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:15.602 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:14.615282+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T13:16:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 5 2024-04-25T13:16:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2dfc06c8f0 msgr2=0x7f2dfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2dfc06c8f0 0x7f2dfc06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007fd0 tx=0x7f2e140079f0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1815b600 msgr2=0x7f2e181f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1815b600 0x7f2e181f4440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e08034040 tx=0x7f2e08004730 comp rx=0 tx=0).stop 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 shutdown_connections 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2dfc06c8f0 0x7f2dfc06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e1815ba40 0x7f2e181f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1815b600 0x7f2e181f4440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 --2- 172.21.15.26:0/2794980817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e04004800 0x7f2e18154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.604+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 >> 172.21.15.26:0/2794980817 conn(0x7f2e18074d50 msgr2=0x7f2e180cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.605+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 shutdown_connections 2024-04-25T13:16:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.605+0000 7f2e1fa7c640 1 -- 172.21.15.26:0/2794980817 wait complete. 2024-04-25T13:16:15.616 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:15.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.716+0000 7fb9396a7640 1 Processor -- start 2024-04-25T13:16:15.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.716+0000 7fb9396a7640 1 -- start start 2024-04-25T13:16:15.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb9396a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 0x7fb9340b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb9396a7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb9340b5450 0x7fb9340d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb9396a7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9341558c0 con 0x7fb9341554e0 2024-04-25T13:16:15.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb9396a7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb9340b4a80 con 0x7fb9340b5450 2024-04-25T13:16:15.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb9396a7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb9340cb8c0 con 0x7fb9340b3c00 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb932ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb9341554e0 0x7fb93415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52072/0 (socket says 172.21.15.26:52072) 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb932ffd640 1 -- 172.21.15.26:0/3785896349 learned_addr learned my addr 172.21.15.26:0/3785896349 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 0x7fb9340b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb9337fe640 1 --2- 172.21.15.26:0/3785896349 >> v2:172.21.15.169:3300/0 conn(0x7fb9340b5450 0x7fb9340d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011888156 0 0) 0x7fb924001110 con 0x7fb9341554e0 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb91c003520 con 0x7fb9341554e0 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 521365677 0 0) 0x7fb91c003520 con 0x7fb9341554e0 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 msgr2=0x7fb9340b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 0x7fb9340b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 >> v2:172.21.15.169:3300/0 conn(0x7fb9340b5450 msgr2=0x7fb9340d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 --2- 172.21.15.26:0/3785896349 >> v2:172.21.15.169:3300/0 conn(0x7fb9340b5450 0x7fb9340d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9340cbba0 con 0x7fb9341554e0 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7fb924001840 con 0x7fb9341554e0 2024-04-25T13:16:15.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 >> v1:172.21.15.26:6789/0 conn(0x7fb9341554e0 legacy=0x7fb93415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 0x7fb91c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb91c003f30 0x7fb91c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c004d40 0x7fb91c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340b4a80 con 0x7fb91c003f30 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.717+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340cb8c0 con 0x7fb91c004d40 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c00b9f0 con 0x7fb9340b3c00 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb91c003f30 0x7fb91c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb932ffd640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 0x7fb91c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9337fe640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c004d40 0x7fb91c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9327fc640 1 -- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 msgr2=0x7fb91c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9340b3c00 0x7fb91c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9327fc640 1 -- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c004d40 msgr2=0x7fb91c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c004d40 0x7fb91c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9327fc640 1 -- 172.21.15.26:0/3785896349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c003520 con 0x7fb91c003f30 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.718+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb91c003f30 0x7fb91c004800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb928009ac0 tx=0x7fb91c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b828c0421758b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928036070 con 0x7fb91c003f30 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb928031400 con 0x7fb91c003f30 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb931ffb640 1 -- 172.21.15.26:0/3785896349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928009690 con 0x7fb91c003f30 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb9396a7640 1 -- 172.21.15.26:0/3785896349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb91c003f30 msgr2=0x7fb91c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb9396a7640 1 --2- 172.21.15.26:0/3785896349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb91c003f30 0x7fb91c004800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb928009ac0 tx=0x7fb91c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb9337fe640 1 -- 172.21.15.26:0/3785896349 reap_dead start 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb9396a7640 1 -- 172.21.15.26:0/3785896349 shutdown_connections 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb9396a7640 1 -- 172.21.15.26:0/3785896349 >> 172.21.15.26:0/3785896349 conn(0x7fb934074d50 msgr2=0x7fb934075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb9396a7640 1 -- 172.21.15.26:0/3785896349 shutdown_connections 2024-04-25T13:16:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.719+0000 7fb9396a7640 1 -- 172.21.15.26:0/3785896349 wait complete. 2024-04-25T13:16:15.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.720+0000 7fb9396a7640 1 Processor -- start 2024-04-25T13:16:15.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9396a7640 1 -- start start 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9396a7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c003f30 0x7fb9341544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9396a7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9340caa90 0x7fb93414c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9396a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb93414eba0 0x7fb93414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9396a7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340b4710 con 0x7fb9340caa90 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9396a7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340b4430 con 0x7fb91c003f30 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9396a7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb9340b3580 con 0x7fb93414eba0 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9340caa90 0x7fb93414c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9340caa90 0x7fb93414c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33560/0 (socket says 172.21.15.26:33560) 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9327fc640 1 -- 172.21.15.26:0/3351628574 learned_addr learned my addr 172.21.15.26:0/3351628574 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb9337fe640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb93414eba0 0x7fb93414c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.721+0000 7fb932ffd640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c003f30 0x7fb9341544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9327fc640 1 -- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb93414eba0 msgr2=0x7fb93414c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb93414eba0 0x7fb93414c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9327fc640 1 -- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c003f30 msgr2=0x7fb9341544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c003f30 0x7fb9341544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9327fc640 1 -- 172.21.15.26:0/3351628574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9340c8240 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9337fe640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb93414eba0 0x7fb93414c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb932ffd640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c003f30 0x7fb9341544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9327fc640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9340caa90 0x7fb93414c470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb928000c00 tx=0x7fb928004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb91b7fe640 1 -- 172.21.15.26:0/3351628574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928040020 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb91b7fe640 1 -- 172.21.15.26:0/3351628574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb928003c60 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9340c9d00 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb91b7fe640 1 -- 172.21.15.26:0/3351628574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928036040 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.722+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9340c9a20 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.723+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9340cf8c0 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.723+0000 7fb91b7fe640 1 -- 172.21.15.26:0/3351628574 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb928043020 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.724+0000 7fb91b7fe640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb92006c8f0 0x7fb92006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.724+0000 7fb91b7fe640 1 -- 172.21.15.26:0/3351628574 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb9280abeb0 con 0x7fb9340caa90 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.724+0000 7fb932ffd640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb92006c8f0 0x7fb92006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.724+0000 7fb932ffd640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb92006c8f0 0x7fb92006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9240012f0 tx=0x7fb924009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.728+0000 7fb91b7fe640 1 -- 172.21.15.26:0/3351628574 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9340cf8c0 con 0x7fb9340caa90 2024-04-25T13:16:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.913+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb934068e40 con 0x7fb9340caa90 2024-04-25T13:16:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.914+0000 7fb91b7fe640 1 -- 172.21.15.26:0/3351628574 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7fb92804a070 con 0x7fb9340caa90 2024-04-25T13:16:15.915 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:15.915 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:15.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb92006c8f0 msgr2=0x7fb92006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb92006c8f0 0x7fb92006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9240012f0 tx=0x7fb924009040 comp rx=0 tx=0).stop 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9340caa90 msgr2=0x7fb93414c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9340caa90 0x7fb93414c470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb928000c00 tx=0x7fb928004730 comp rx=0 tx=0).stop 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 shutdown_connections 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb92006c8f0 0x7fb92006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb93414eba0 0x7fb93414c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9340caa90 0x7fb93414c470 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 --2- 172.21.15.26:0/3351628574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c003f30 0x7fb9341544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.916+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 >> 172.21.15.26:0/3351628574 conn(0x7fb934074d50 msgr2=0x7fb9340ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.917+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 shutdown_connections 2024-04-25T13:16:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:15.917+0000 7fb9396a7640 1 -- 172.21.15.26:0/3351628574 wait complete. 2024-04-25T13:16:15.927 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:16.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.028+0000 7f6f18d6a640 1 Processor -- start 2024-04-25T13:16:16.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.028+0000 7f6f18d6a640 1 -- start start 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f18d6a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6f14152fd0 0x7f6f14071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f18d6a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14074410 0x7f6f1415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f18d6a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f140c7bd0 con 0x7f6f140c6e00 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f18d6a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6f140c86a0 con 0x7f6f14152fd0 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f18d6a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140c8980 con 0x7f6f14074410 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f11d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14074410 0x7f6f1415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f12d9d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f6f140c6e00 0x7f6f14073730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:37486/0 (socket says 172.21.15.26:37486) 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f1259c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6f14152fd0 0x7f6f14071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f12d9d640 1 -- 172.21.15.26:0/2214728547 learned_addr learned my addr 172.21.15.26:0/2214728547 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f1159a640 1 -- 172.21.15.26:0/2214728547 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454561136 0 0) 0x7f6f140c7bd0 con 0x7f6f140c6e00 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f1159a640 1 -- 172.21.15.26:0/2214728547 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6efc003520 con 0x7f6f140c6e00 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f11d9b640 1 -- 172.21.15.26:0/2214728547 >> v2:172.21.15.169:3300/0 conn(0x7f6f14152fd0 msgr2=0x7f6f14071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f11d9b640 1 --2- 172.21.15.26:0/2214728547 >> v2:172.21.15.169:3300/0 conn(0x7f6f14152fd0 0x7f6f14071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f11d9b640 1 -- 172.21.15.26:0/2214728547 >> v1:172.21.15.169:6789/0 conn(0x7f6f140c6e00 legacy=0x7f6f14073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.029+0000 7f6f11d9b640 1 -- 172.21.15.26:0/2214728547 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1415c3d0 con 0x7f6f14074410 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.030+0000 7f6f11d9b640 1 --2- 172.21.15.26:0/2214728547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14074410 0x7f6f1415ceb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f080097a0 tx=0x7f6f0802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff93eee6942fe23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.030+0000 7f6f1159a640 1 -- 172.21.15.26:0/2214728547 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08037070 con 0x7f6f14074410 2024-04-25T13:16:16.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.030+0000 7f6f1159a640 1 -- 172.21.15.26:0/2214728547 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0802ae50 con 0x7f6f14074410 2024-04-25T13:16:16.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.030+0000 7f6f1159a640 1 -- 172.21.15.26:0/2214728547 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08032660 con 0x7f6f14074410 2024-04-25T13:16:16.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2214728547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14074410 msgr2=0x7f6f1415ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2214728547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14074410 0x7f6f1415ceb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f080097a0 tx=0x7f6f0802a100 comp rx=0 tx=0).stop 2024-04-25T13:16:16.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2214728547 shutdown_connections 2024-04-25T13:16:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2214728547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14074410 0x7f6f1415ceb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2214728547 >> v2:172.21.15.169:3300/0 conn(0x7f6f14152fd0 0x7f6f14071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2214728547 >> 172.21.15.26:0/2214728547 conn(0x7f6f140c8f00 msgr2=0x7f6f140c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2214728547 shutdown_connections 2024-04-25T13:16:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.031+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2214728547 wait complete. 2024-04-25T13:16:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.032+0000 7f6f18d6a640 1 Processor -- start 2024-04-25T13:16:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.032+0000 7f6f18d6a640 1 -- start start 2024-04-25T13:16:16.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f18d6a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f14074410 0x7f6f14156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f18d6a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f140c6e00 0x7f6f141482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f18d6a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14152fd0 0x7f6f140c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f18d6a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140c8c60 con 0x7f6f14074410 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f18d6a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1415c990 con 0x7f6f140c6e00 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f18d6a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6f141533b0 con 0x7f6f14152fd0 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f1259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f14074410 0x7f6f14156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f1259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f14074410 0x7f6f14156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33570/0 (socket says 172.21.15.26:33570) 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f1259c640 1 -- 172.21.15.26:0/2187886946 learned_addr learned my addr 172.21.15.26:0/2187886946 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f11d9b640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f140c6e00 0x7f6f141482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.033+0000 7f6f12d9d640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14152fd0 0x7f6f140c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f1259c640 1 -- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14152fd0 msgr2=0x7f6f140c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f1259c640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14152fd0 0x7f6f140c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f1259c640 1 -- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f140c6e00 msgr2=0x7f6f141482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f1259c640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f140c6e00 0x7f6f141482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f1259c640 1 -- 172.21.15.26:0/2187886946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f14154fd0 con 0x7f6f14074410 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f12d9d640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14152fd0 0x7f6f140c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f1259c640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f14074410 0x7f6f14156000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e9b0 tx=0x7f6f0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f02ffd640 1 -- 172.21.15.26:0/2187886946 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04017070 con 0x7f6f14074410 2024-04-25T13:16:16.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f02ffd640 1 -- 172.21.15.26:0/2187886946 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0400c9a0 con 0x7f6f14074410 2024-04-25T13:16:16.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f141f4ca0 con 0x7f6f14074410 2024-04-25T13:16:16.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f02ffd640 1 -- 172.21.15.26:0/2187886946 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400cd90 con 0x7f6f14074410 2024-04-25T13:16:16.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.034+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f14155520 con 0x7f6f14074410 2024-04-25T13:16:16.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.035+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f14069310 con 0x7f6f14074410 2024-04-25T13:16:16.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.035+0000 7f6f02ffd640 1 -- 172.21.15.26:0/2187886946 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f0401a070 con 0x7f6f14074410 2024-04-25T13:16:16.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.036+0000 7f6f02ffd640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ef406c8f0 0x7f6ef406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.036+0000 7f6f02ffd640 1 -- 172.21.15.26:0/2187886946 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6f0408be80 con 0x7f6f14074410 2024-04-25T13:16:16.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.036+0000 7f6f11d9b640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ef406c8f0 0x7f6ef406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.037+0000 7f6f11d9b640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ef406c8f0 0x7f6ef406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f08034000 tx=0x7f6f0802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.041+0000 7f6f02ffd640 1 -- 172.21.15.26:0/2187886946 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f14069310 con 0x7f6f14074410 2024-04-25T13:16:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.230+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f14068e40 con 0x7f6f14074410 2024-04-25T13:16:16.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.231+0000 7f6f02ffd640 1 -- 172.21.15.26:0/2187886946 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f6f04059880 con 0x7f6f14074410 2024-04-25T13:16:16.231 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:16.231 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ef406c8f0 msgr2=0x7f6ef406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ef406c8f0 0x7f6ef406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f08034000 tx=0x7f6f0802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f14074410 msgr2=0x7f6f14156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f14074410 0x7f6f14156000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e9b0 tx=0x7f6f0400ee70 comp rx=0 tx=0).stop 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 shutdown_connections 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ef406c8f0 0x7f6ef406edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f14152fd0 0x7f6f140c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f140c6e00 0x7f6f141482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 --2- 172.21.15.26:0/2187886946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f14074410 0x7f6f14156000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 >> 172.21.15.26:0/2187886946 conn(0x7f6f140c8f00 msgr2=0x7f6f140c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:16.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 shutdown_connections 2024-04-25T13:16:16.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.233+0000 7f6f18d6a640 1 -- 172.21.15.26:0/2187886946 wait complete. 2024-04-25T13:16:16.258 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.360+0000 7f54aa2a0640 1 Processor -- start 2024-04-25T13:16:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.360+0000 7f54aa2a0640 1 -- start start 2024-04-25T13:16:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54aa2a0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f54a40b3c00 0x7f54a40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54aa2a0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54a40b5450 0x7f54a40d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54aa2a0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a41558c0 con 0x7f54a41554e0 2024-04-25T13:16:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54aa2a0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f54a40b4a80 con 0x7f54a40b5450 2024-04-25T13:16:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54aa2a0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f54a40cb8c0 con 0x7f54a40b3c00 2024-04-25T13:16:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a883d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54a40b5450 0x7f54a40d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a883d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54a40b5450 0x7f54a40d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33578/0 (socket says 172.21.15.26:33578) 2024-04-25T13:16:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a883d640 1 -- 172.21.15.26:0/1664841320 learned_addr learned my addr 172.21.15.26:0/1664841320 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a37fe640 1 --2- 172.21.15.26:0/1664841320 >> v2:172.21.15.169:3300/0 conn(0x7f54a40b3c00 0x7f54a40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a883d640 1 -- 172.21.15.26:0/1664841320 >> v2:172.21.15.169:3300/0 conn(0x7f54a40b3c00 msgr2=0x7f54a40b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a883d640 1 --2- 172.21.15.26:0/1664841320 >> v2:172.21.15.169:3300/0 conn(0x7f54a40b3c00 0x7f54a40b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a883d640 1 -- 172.21.15.26:0/1664841320 >> v1:172.21.15.169:6789/0 conn(0x7f54a41554e0 legacy=0x7f54a415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.361+0000 7f54a883d640 1 -- 172.21.15.26:0/1664841320 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a40cbba0 con 0x7f54a40b5450 2024-04-25T13:16:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.362+0000 7f54a883d640 1 --2- 172.21.15.26:0/1664841320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a40d08a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54a40b6040 tx=0x7f549c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89c88935726743a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.362+0000 7f54a2ffd640 1 -- 172.21.15.26:0/1664841320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c036070 con 0x7f54a40b5450 2024-04-25T13:16:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.362+0000 7f54a2ffd640 1 -- 172.21.15.26:0/1664841320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c031600 con 0x7f54a40b5450 2024-04-25T13:16:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.362+0000 7f54a2ffd640 1 -- 172.21.15.26:0/1664841320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c0319f0 con 0x7f54a40b5450 2024-04-25T13:16:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 -- 172.21.15.26:0/1664841320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 msgr2=0x7f54a40d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/1664841320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a40d08a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54a40b6040 tx=0x7f549c02a7c0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 -- 172.21.15.26:0/1664841320 shutdown_connections 2024-04-25T13:16:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/1664841320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a40d08a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/1664841320 >> v2:172.21.15.169:3300/0 conn(0x7f54a40b3c00 0x7f54a40b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 -- 172.21.15.26:0/1664841320 >> 172.21.15.26:0/1664841320 conn(0x7f54a4074d50 msgr2=0x7f54a4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 -- 172.21.15.26:0/1664841320 shutdown_connections 2024-04-25T13:16:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.363+0000 7f54aa2a0640 1 -- 172.21.15.26:0/1664841320 wait complete. 2024-04-25T13:16:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.364+0000 7f54aa2a0640 1 Processor -- start 2024-04-25T13:16:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.364+0000 7f54aa2a0640 1 -- start start 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54aa2a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a40b3c00 0x7f54a4149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54aa2a0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54aa2a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41554e0 0x7f54a40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54aa2a0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f54a40b4710 con 0x7f54a40b5450 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54aa2a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54a40b4430 con 0x7f54a41554e0 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54aa2a0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f54a40b3580 con 0x7f54a40b3c00 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a414ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33584/0 (socket says 172.21.15.26:33584) 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 -- 172.21.15.26:0/3582270274 learned_addr learned my addr 172.21.15.26:0/3582270274 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a3fff640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a40b3c00 0x7f54a4149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 -- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a40b3c00 msgr2=0x7f54a4149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a883d640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41554e0 0x7f54a40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a40b3c00 0x7f54a4149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 -- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41554e0 msgr2=0x7f54a40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41554e0 0x7f54a40c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 -- 172.21.15.26:0/3582270274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a40ca220 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a883d640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41554e0 0x7f54a40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a3fff640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a40b3c00 0x7f54a4149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.365+0000 7f54a37fe640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a414ad90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f549400d5f0 tx=0x7f549400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.366+0000 7f54a0ff9640 1 -- 172.21.15.26:0/3582270274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940125f0 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.366+0000 7f54a0ff9640 1 -- 172.21.15.26:0/3582270274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494019070 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.366+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a40ca4c0 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.366+0000 7f54a0ff9640 1 -- 172.21.15.26:0/3582270274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940129d0 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.366+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a40caa80 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.367+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a4068e40 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.367+0000 7f54a0ff9640 1 -- 172.21.15.26:0/3582270274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5494012b70 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.367+0000 7f54a0ff9640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f549006c8f0 0x7f549006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.368+0000 7f54a0ff9640 1 -- 172.21.15.26:0/3582270274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f549408c290 con 0x7f54a40b5450 2024-04-25T13:16:16.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.368+0000 7f54a3fff640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f549006c8f0 0x7f549006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.368+0000 7f54a3fff640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f549006c8f0 0x7f549006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5498001680 tx=0x7f5498009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.372+0000 7f54a0ff9640 1 -- 172.21.15.26:0/3582270274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f549405a380 con 0x7f54a40b5450 2024-04-25T13:16:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.592+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54a40c7010 con 0x7f54a40b5450 2024-04-25T13:16:16.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.593+0000 7f54a0ff9640 1 -- 172.21.15.26:0/3582270274 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6823 (secure 0 0 0) 0x7f5494059c80 con 0x7f54a40b5450 2024-04-25T13:16:16.593 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:16.593 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:14.615282+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T13:16:16.593 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 5 2024-04-25T13:16:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f549006c8f0 msgr2=0x7f549006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f549006c8f0 0x7f549006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5498001680 tx=0x7f5498009040 comp rx=0 tx=0).stop 2024-04-25T13:16:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 msgr2=0x7f54a414ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a414ad90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f549400d5f0 tx=0x7f549400dab0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 shutdown_connections 2024-04-25T13:16:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f549006c8f0 0x7f549006edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41554e0 0x7f54a40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54a40b5450 0x7f54a414ad90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 --2- 172.21.15.26:0/3582270274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a40b3c00 0x7f54a4149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 >> 172.21.15.26:0/3582270274 conn(0x7f54a4074d50 msgr2=0x7f54a4154740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 shutdown_connections 2024-04-25T13:16:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.595+0000 7f54aa2a0640 1 -- 172.21.15.26:0/3582270274 wait complete. 2024-04-25T13:16:16.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:16.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.706+0000 7f7282264640 1 Processor -- start 2024-04-25T13:16:16.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f7282264640 1 -- start start 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f7282264640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f727c144270 0x7f727c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f7282264640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f727c0c9290 0x7f727c075460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f7282264640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f727c144650 con 0x7f727c0c8e70 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f7282264640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f727c15f4e0 con 0x7f727c144270 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f7282264640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f727c0ce080 con 0x7f727c0c9290 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f727bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f727c144270 0x7f727c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f727bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f727c144270 0x7f727c15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33600/0 (socket says 172.21.15.26:33600) 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.707+0000 7f727bfff640 1 -- 172.21.15.26:0/3336721533 learned_addr learned my addr 172.21.15.26:0/3336721533 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.708+0000 7f7280801640 1 --2- 172.21.15.26:0/3336721533 >> v2:172.21.15.169:3300/0 conn(0x7f727c0c9290 0x7f727c075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.708+0000 7f727bfff640 1 -- 172.21.15.26:0/3336721533 >> v2:172.21.15.169:3300/0 conn(0x7f727c0c9290 msgr2=0x7f727c075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.708+0000 7f727bfff640 1 --2- 172.21.15.26:0/3336721533 >> v2:172.21.15.169:3300/0 conn(0x7f727c0c9290 0x7f727c075460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.708+0000 7f727bfff640 1 -- 172.21.15.26:0/3336721533 >> v1:172.21.15.169:6789/0 conn(0x7f727c0c8e70 legacy=0x7f727c074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.708+0000 7f727bfff640 1 -- 172.21.15.26:0/3336721533 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c15b0b0 con 0x7f727c144270 2024-04-25T13:16:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.708+0000 7f727bfff640 1 --2- 172.21.15.26:0/3336721533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15efa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f727c06da70 tx=0x7f726402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb7b9586ef5a855 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f727affd640 1 -- 172.21.15.26:0/3336721533 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264037070 con 0x7f727c144270 2024-04-25T13:16:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f727affd640 1 -- 172.21.15.26:0/3336721533 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7264032440 con 0x7f727c144270 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f727affd640 1 -- 172.21.15.26:0/3336721533 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264032810 con 0x7f727c144270 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 -- 172.21.15.26:0/3336721533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 msgr2=0x7f727c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 --2- 172.21.15.26:0/3336721533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15efa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f727c06da70 tx=0x7f726402a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 -- 172.21.15.26:0/3336721533 shutdown_connections 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 --2- 172.21.15.26:0/3336721533 >> v2:172.21.15.169:3300/0 conn(0x7f727c0c9290 0x7f727c075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 --2- 172.21.15.26:0/3336721533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15efa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 -- 172.21.15.26:0/3336721533 >> 172.21.15.26:0/3336721533 conn(0x7f727c06b920 msgr2=0x7f727c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 -- 172.21.15.26:0/3336721533 shutdown_connections 2024-04-25T13:16:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.709+0000 7f7282264640 1 -- 172.21.15.26:0/3336721533 wait complete. 2024-04-25T13:16:16.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.710+0000 7f7282264640 1 Processor -- start 2024-04-25T13:16:16.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7282264640 1 -- start start 2024-04-25T13:16:16.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7282264640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f727c0c8e70 0x7f727c1f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7282264640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727c0c9290 0x7f727c15e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7282264640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7282264640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f727c15b8e0 con 0x7f727c144270 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7282264640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f727c15b600 con 0x7f727c0c8e70 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7282264640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f727c0ce360 con 0x7f727c0c9290 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7280801640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.711+0000 7f7280801640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33606/0 (socket says 172.21.15.26:33606) 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7280801640 1 -- 172.21.15.26:0/1467784377 learned_addr learned my addr 172.21.15.26:0/1467784377 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f727bfff640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f727c0c8e70 0x7f727c1f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f727b7fe640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727c0c9290 0x7f727c15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7280801640 1 -- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727c0c9290 msgr2=0x7f727c15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7280801640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727c0c9290 0x7f727c15e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7280801640 1 -- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f727c0c8e70 msgr2=0x7f727c1f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7280801640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f727c0c8e70 0x7f727c1f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7280801640 1 -- 172.21.15.26:0/1467784377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c157a30 con 0x7f727c144270 2024-04-25T13:16:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7280801640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15c160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f727400cda0 tx=0x7f727400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7278ff9640 1 -- 172.21.15.26:0/1467784377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274003b90 con 0x7f727c144270 2024-04-25T13:16:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7278ff9640 1 -- 172.21.15.26:0/1467784377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274003d30 con 0x7f727c144270 2024-04-25T13:16:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c157d10 con 0x7f727c144270 2024-04-25T13:16:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7278ff9640 1 -- 172.21.15.26:0/1467784377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274004240 con 0x7f727c144270 2024-04-25T13:16:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.712+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c1582d0 con 0x7f727c144270 2024-04-25T13:16:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.713+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727c068e40 con 0x7f727c144270 2024-04-25T13:16:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.714+0000 7f7278ff9640 1 -- 172.21.15.26:0/1467784377 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72740043e0 con 0x7f727c144270 2024-04-25T13:16:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.714+0000 7f7278ff9640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f725c06c920 0x7f725c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.714+0000 7f7278ff9640 1 -- 172.21.15.26:0/1467784377 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f727408c7b0 con 0x7f727c144270 2024-04-25T13:16:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.714+0000 7f727bfff640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f725c06c920 0x7f725c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.715+0000 7f727bfff640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f725c06c920 0x7f725c06ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7264034000 tx=0x7f726402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:16.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.719+0000 7f7278ff9640 1 -- 172.21.15.26:0/1467784377 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f727405a250 con 0x7f727c144270 2024-04-25T13:16:16.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.906+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f727c143570 con 0x7f727c144270 2024-04-25T13:16:16.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.907+0000 7f7278ff9640 1 -- 172.21.15.26:0/1467784377 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f727405e550 con 0x7f727c144270 2024-04-25T13:16:16.907 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:16.907 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:16.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f725c06c920 msgr2=0x7f725c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f725c06c920 0x7f725c06ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7264034000 tx=0x7f726402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:16.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 msgr2=0x7f727c15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:16.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15c160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f727400cda0 tx=0x7f727400a660 comp rx=0 tx=0).stop 2024-04-25T13:16:16.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 shutdown_connections 2024-04-25T13:16:16.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f725c06c920 0x7f725c06ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f727c144270 0x7f727c15c160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727c0c9290 0x7f727c15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 --2- 172.21.15.26:0/1467784377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f727c0c8e70 0x7f727c1f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:16.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 >> 172.21.15.26:0/1467784377 conn(0x7f727c06b920 msgr2=0x7f727c1410d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:16.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 shutdown_connections 2024-04-25T13:16:16.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:16.909+0000 7f7282264640 1 -- 172.21.15.26:0/1467784377 wait complete. 2024-04-25T13:16:17.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:09.585455+0000', 'modified': '2024-04-25T13:16:14.615282+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.169:6839/963417679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 963417679}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 963417679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T13:16:17.523 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4308:up:creating 2024-04-25T13:16:18.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.638+0000 7fcc6a7bb640 1 Processor -- start 2024-04-25T13:16:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.638+0000 7fcc6a7bb640 1 -- start start 2024-04-25T13:16:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc6a7bb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc641554e0 0x7fcc6415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc6a7bb640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc641558c0 con 0x7fcc640d08a0 2024-04-25T13:16:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc6a7bb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6415f630 con 0x7fcc640b3c00 2024-04-25T13:16:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc6a7bb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcc640b4a80 con 0x7fcc641554e0 2024-04-25T13:16:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc63fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc641554e0 0x7fcc6415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc68d58640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcc640d08a0 0x7fcc64165a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52084/0 (socket says 172.21.15.26:52084) 2024-04-25T13:16:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc68d58640 1 -- 172.21.15.26:0/943549092 learned_addr learned my addr 172.21.15.26:0/943549092 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc63fff640 1 -- 172.21.15.26:0/943549092 >> v1:172.21.15.169:6789/0 conn(0x7fcc640b3c00 legacy=0x7fcc640b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc63fff640 1 -- 172.21.15.26:0/943549092 >> v1:172.21.15.26:6789/0 conn(0x7fcc640d08a0 legacy=0x7fcc64165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc62ffd640 1 -- 172.21.15.26:0/943549092 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979273322 0 0) 0x7fcc5c001490 con 0x7fcc640d08a0 2024-04-25T13:16:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.639+0000 7fcc63fff640 1 -- 172.21.15.26:0/943549092 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc640cb8c0 con 0x7fcc641554e0 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.640+0000 7fcc63fff640 1 --2- 172.21.15.26:0/943549092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc6415f0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b4c00 tx=0x7fcc5402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41820f097d4b7f0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.640+0000 7fcc62ffd640 1 -- 172.21.15.26:0/943549092 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54037070 con 0x7fcc641554e0 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.640+0000 7fcc62ffd640 1 -- 172.21.15.26:0/943549092 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc54032640 con 0x7fcc641554e0 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.640+0000 7fcc62ffd640 1 -- 172.21.15.26:0/943549092 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54032a10 con 0x7fcc641554e0 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.641+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/943549092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 msgr2=0x7fcc6415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.641+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/943549092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc6415f0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b4c00 tx=0x7fcc5402a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.641+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/943549092 shutdown_connections 2024-04-25T13:16:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.641+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/943549092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc6415f0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.641+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/943549092 >> 172.21.15.26:0/943549092 conn(0x7fcc64074d50 msgr2=0x7fcc64075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.641+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/943549092 shutdown_connections 2024-04-25T13:16:18.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.641+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/943549092 wait complete. 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.642+0000 7fcc6a7bb640 1 Processor -- start 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.642+0000 7fcc6a7bb640 1 -- start start 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc6a7bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc640b3c00 0x7fcc6415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc6a7bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc640d08a0 0x7fcc641e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc6a7bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc640c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc6a7bb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcc640b4430 con 0x7fcc641554e0 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc6a7bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcc640b4150 con 0x7fcc640d08a0 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc6a7bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcc640b4710 con 0x7fcc640b3c00 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc640c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc640c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33618/0 (socket says 172.21.15.26:33618) 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 -- 172.21.15.26:0/1958259688 learned_addr learned my addr 172.21.15.26:0/1958259688 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc637fe640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc640d08a0 0x7fcc641e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc63fff640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc640b3c00 0x7fcc6415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 -- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc640b3c00 msgr2=0x7fcc6415ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc640b3c00 0x7fcc6415ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 -- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc640d08a0 msgr2=0x7fcc641e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc640d08a0 0x7fcc641e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc68d58640 1 -- 172.21.15.26:0/1958259688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc640c7220 con 0x7fcc641554e0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.643+0000 7fcc637fe640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc640d08a0 0x7fcc641e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.644+0000 7fcc68d58640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc640c8ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00cb60 tx=0x7fcc5c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.644+0000 7fcc60ff9640 1 -- 172.21.15.26:0/1958259688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00ace0 con 0x7fcc641554e0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.644+0000 7fcc60ff9640 1 -- 172.21.15.26:0/1958259688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c012400 con 0x7fcc641554e0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.644+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6415cdf0 con 0x7fcc641554e0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.644+0000 7fcc60ff9640 1 -- 172.21.15.26:0/1958259688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0127f0 con 0x7fcc641554e0 2024-04-25T13:16:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.644+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6415d3b0 con 0x7fcc641554e0 2024-04-25T13:16:18.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.645+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc64155040 con 0x7fcc641554e0 2024-04-25T13:16:18.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.646+0000 7fcc60ff9640 1 -- 172.21.15.26:0/1958259688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc5c012990 con 0x7fcc641554e0 2024-04-25T13:16:18.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.646+0000 7fcc60ff9640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4406c8f0 0x7fcc4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.646+0000 7fcc60ff9640 1 -- 172.21.15.26:0/1958259688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcc5c08c4b0 con 0x7fcc641554e0 2024-04-25T13:16:18.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.646+0000 7fcc63fff640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4406c8f0 0x7fcc4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.647+0000 7fcc63fff640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4406c8f0 0x7fcc4406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcc54034000 tx=0x7fcc5402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.650+0000 7fcc60ff9640 1 -- 172.21.15.26:0/1958259688 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc64155040 con 0x7fcc641554e0 2024-04-25T13:16:18.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.881+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc64069730 con 0x7fcc641554e0 2024-04-25T13:16:18.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.881+0000 7fcc60ff9640 1 -- 172.21.15.26:0/1958259688 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6823 (secure 0 0 0) 0x7fcc64069730 con 0x7fcc641554e0 2024-04-25T13:16:18.881 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:18.881 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:14.615282+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T13:16:18.881 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 5 2024-04-25T13:16:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4406c8f0 msgr2=0x7fcc4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4406c8f0 0x7fcc4406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcc54034000 tx=0x7fcc5402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 msgr2=0x7fcc640c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc640c8ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00cb60 tx=0x7fcc5c00a430 comp rx=0 tx=0).stop 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 shutdown_connections 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4406c8f0 0x7fcc4406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc641554e0 0x7fcc640c8ba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc640d08a0 0x7fcc641e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 --2- 172.21.15.26:0/1958259688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc640b3c00 0x7fcc6415ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 >> 172.21.15.26:0/1958259688 conn(0x7fcc64074d50 msgr2=0x7fcc64153430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 shutdown_connections 2024-04-25T13:16:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:18.883+0000 7fcc6a7bb640 1 -- 172.21.15.26:0/1958259688 wait complete. 2024-04-25T13:16:19.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:09.585455+0000', 'modified': '2024-04-25T13:16:14.615282+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.169:6839/963417679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 963417679}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 963417679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T13:16:19.497 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4308:up:creating 2024-04-25T13:16:20.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.611+0000 7fa798433640 1 Processor -- start 2024-04-25T13:16:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.611+0000 7fa798433640 1 -- start start 2024-04-25T13:16:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.612+0000 7fa798433640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7901554e0 0x7fa79015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.612+0000 7fa798433640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7901558c0 con 0x7fa7900b3c00 2024-04-25T13:16:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.612+0000 7fa798433640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79015f630 con 0x7fa7900d08a0 2024-04-25T13:16:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.612+0000 7fa798433640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa7900b4a80 con 0x7fa7901554e0 2024-04-25T13:16:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.612+0000 7fa7961cf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7901554e0 0x7fa79015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.612+0000 7fa7959ce640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa7900b3c00 0x7fa7900b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52090/0 (socket says 172.21.15.26:52090) 2024-04-25T13:16:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.612+0000 7fa7959ce640 1 -- 172.21.15.26:0/1865027267 learned_addr learned my addr 172.21.15.26:0/1865027267 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.613+0000 7fa7961cf640 1 -- 172.21.15.26:0/1865027267 >> v1:172.21.15.169:6789/0 conn(0x7fa7900d08a0 legacy=0x7fa790165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.613+0000 7fa7961cf640 1 -- 172.21.15.26:0/1865027267 >> v1:172.21.15.26:6789/0 conn(0x7fa7900b3c00 legacy=0x7fa7900b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.613+0000 7fa7961cf640 1 -- 172.21.15.26:0/1865027267 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7900cb8c0 con 0x7fa7901554e0 2024-04-25T13:16:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.613+0000 7fa7961cf640 1 --2- 172.21.15.26:0/1865027267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa79015f0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7900b4c00 tx=0x7fa78c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c4bf1a46ac8fac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa7951cd640 1 -- 172.21.15.26:0/1865027267 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c037070 con 0x7fa7901554e0 2024-04-25T13:16:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa7951cd640 1 -- 172.21.15.26:0/1865027267 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78c032640 con 0x7fa7901554e0 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa7951cd640 1 -- 172.21.15.26:0/1865027267 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c032a10 con 0x7fa7901554e0 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa798433640 1 -- 172.21.15.26:0/1865027267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 msgr2=0x7fa79015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa798433640 1 --2- 172.21.15.26:0/1865027267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa79015f0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7900b4c00 tx=0x7fa78c02a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa798433640 1 -- 172.21.15.26:0/1865027267 shutdown_connections 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa798433640 1 --2- 172.21.15.26:0/1865027267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa79015f0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa798433640 1 -- 172.21.15.26:0/1865027267 >> 172.21.15.26:0/1865027267 conn(0x7fa790074d50 msgr2=0x7fa790075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa798433640 1 -- 172.21.15.26:0/1865027267 shutdown_connections 2024-04-25T13:16:20.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.614+0000 7fa798433640 1 -- 172.21.15.26:0/1865027267 wait complete. 2024-04-25T13:16:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 Processor -- start 2024-04-25T13:16:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 -- start start 2024-04-25T13:16:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7900b3c00 0x7fa7900c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7900d08a0 0x7fa790150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa7901f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa7900b4430 con 0x7fa7901554e0 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7900b4150 con 0x7fa7900b3c00 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa798433640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa7900b4710 con 0x7fa7900d08a0 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa7969d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa7901f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa7969d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa7901f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33636/0 (socket says 172.21.15.26:33636) 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.616+0000 7fa7969d0640 1 -- 172.21.15.26:0/3114764675 learned_addr learned my addr 172.21.15.26:0/3114764675 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7961cf640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7900b3c00 0x7fa7900c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7959ce640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7900d08a0 0x7fa790150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7969d0640 1 -- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7900d08a0 msgr2=0x7fa790150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7969d0640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7900d08a0 0x7fa790150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7969d0640 1 -- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7900b3c00 msgr2=0x7fa7900c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7969d0640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7900b3c00 0x7fa7900c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7969d0640 1 -- 172.21.15.26:0/3114764675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7901f10b0 con 0x7fa7901554e0 2024-04-25T13:16:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa7969d0640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa7901f1890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c7a0 tx=0x7fa78800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa786ffd640 1 -- 172.21.15.26:0/3114764675 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788003b70 con 0x7fa7901554e0 2024-04-25T13:16:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa786ffd640 1 -- 172.21.15.26:0/3114764675 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa788003d30 con 0x7fa7901554e0 2024-04-25T13:16:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7901f5390 con 0x7fa7901554e0 2024-04-25T13:16:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa786ffd640 1 -- 172.21.15.26:0/3114764675 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78800aa90 con 0x7fa7901554e0 2024-04-25T13:16:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.617+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79015f0e0 con 0x7fa7901554e0 2024-04-25T13:16:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.618+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7900d1580 con 0x7fa7901554e0 2024-04-25T13:16:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.619+0000 7fa786ffd640 1 -- 172.21.15.26:0/3114764675 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa78800ac30 con 0x7fa7901554e0 2024-04-25T13:16:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.619+0000 7fa786ffd640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa77406c8f0 0x7fa77406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.619+0000 7fa786ffd640 1 -- 172.21.15.26:0/3114764675 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa78808bcd0 con 0x7fa7901554e0 2024-04-25T13:16:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.619+0000 7fa7961cf640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa77406c8f0 0x7fa77406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.620+0000 7fa7961cf640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa77406c8f0 0x7fa77406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa78c034000 tx=0x7fa78c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:20.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.624+0000 7fa786ffd640 1 -- 172.21.15.26:0/3114764675 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7900d1580 con 0x7fa7901554e0 2024-04-25T13:16:20.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.851+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7900b3580 con 0x7fa7901554e0 2024-04-25T13:16:20.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.851+0000 7fa786ffd640 1 -- 172.21.15.26:0/3114764675 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6828 (secure 0 0 0) 0x7fa7900b3580 con 0x7fa7901554e0 2024-04-25T13:16:20.851 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:20.851 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:19.248870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-04-25T13:16:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 7 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa77406c8f0 msgr2=0x7fa77406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa77406c8f0 0x7fa77406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa78c034000 tx=0x7fa78c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 msgr2=0x7fa7901f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa7901f1890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c7a0 tx=0x7fa78800cc60 comp rx=0 tx=0).stop 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 shutdown_connections 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa77406c8f0 0x7fa77406edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7901554e0 0x7fa7901f1890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7900d08a0 0x7fa790150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 --2- 172.21.15.26:0/3114764675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7900b3c00 0x7fa7900c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 >> 172.21.15.26:0/3114764675 conn(0x7fa790074d50 msgr2=0x7fa7900cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 shutdown_connections 2024-04-25T13:16:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:20.854+0000 7fa798433640 1 -- 172.21.15.26:0/3114764675 wait complete. 2024-04-25T13:16:21.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:09.585455+0000', 'modified': '2024-04-25T13:16:19.248870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.169:6839/963417679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 963417679}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 963417679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4308, 'qdb_cluster': [4308]} 2024-04-25T13:16:21.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T13:16:21.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T13:16:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.580+0000 7f6ad35c4640 1 Processor -- start 2024-04-25T13:16:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.580+0000 7f6ad35c4640 1 -- start start 2024-04-25T13:16:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad35c4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc1553a0 0x7f6acc0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad35c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6acc0c8070 0x7f6acc0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad35c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc06c850 con 0x7f6acc15bb80 2024-04-25T13:16:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad35c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6acc06cb30 con 0x7f6acc0c8070 2024-04-25T13:16:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad35c4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6acc06ce10 con 0x7f6acc1553a0 2024-04-25T13:16:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad0b5f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6acc0c8070 0x7f6acc0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad1b61640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6acc15bb80 0x7f6acc0ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52098/0 (socket says 172.21.15.26:52098) 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad1b61640 1 -- 172.21.15.26:0/1952807477 learned_addr learned my addr 172.21.15.26:0/1952807477 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1952807477 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc1553a0 0x7f6acc0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/1952807477 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc1553a0 msgr2=0x7f6acc0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1952807477 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc1553a0 0x7f6acc0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/1952807477 >> v1:172.21.15.26:6789/0 conn(0x7f6acc15bb80 legacy=0x7f6acc0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ac3fff640 1 -- 172.21.15.26:0/1952807477 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216184107 0 0) 0x7f6acc06c850 con 0x7f6acc15bb80 2024-04-25T13:16:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.581+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/1952807477 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc06d0f0 con 0x7f6acc0c8070 2024-04-25T13:16:21.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.582+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1952807477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc0c8070 0x7f6acc0c8c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0097a0 tx=0x7f6abc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ec369ec03ce931 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.582+0000 7f6ac3fff640 1 -- 172.21.15.26:0/1952807477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc037070 con 0x7f6acc0c8070 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.582+0000 7f6ac3fff640 1 -- 172.21.15.26:0/1952807477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc032440 con 0x7f6acc0c8070 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.582+0000 7f6ac3fff640 1 -- 172.21.15.26:0/1952807477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc032810 con 0x7f6acc0c8070 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 -- 172.21.15.26:0/1952807477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc0c8070 msgr2=0x7f6acc0c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/1952807477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc0c8070 0x7f6acc0c8c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0097a0 tx=0x7f6abc02a210 comp rx=0 tx=0).stop 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 -- 172.21.15.26:0/1952807477 shutdown_connections 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/1952807477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc0c8070 0x7f6acc0c8c40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/1952807477 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc1553a0 0x7f6acc0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 -- 172.21.15.26:0/1952807477 >> 172.21.15.26:0/1952807477 conn(0x7f6acc073010 msgr2=0x7f6acc073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 -- 172.21.15.26:0/1952807477 shutdown_connections 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.583+0000 7f6ad35c4640 1 -- 172.21.15.26:0/1952807477 wait complete. 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.584+0000 7f6ad35c4640 1 Processor -- start 2024-04-25T13:16:21.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.584+0000 7f6ad35c4640 1 -- start start 2024-04-25T13:16:21.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad35c4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc0c8070 0x7f6acc14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad35c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc1553a0 0x7f6acc0c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad35c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6acc15bb80 0x7f6acc147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad35c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc0cd4d0 con 0x7f6acc1553a0 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad35c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc155780 con 0x7f6acc15bb80 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad35c4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6acc0cd650 con 0x7f6acc0c8070 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc1553a0 0x7f6acc0c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc1553a0 0x7f6acc0c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33652/0 (socket says 172.21.15.26:33652) 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/2860972845 learned_addr learned my addr 172.21.15.26:0/2860972845 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad1360640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc0c8070 0x7f6acc14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad1b61640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6acc15bb80 0x7f6acc147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc0c8070 msgr2=0x7f6acc14dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc0c8070 0x7f6acc14dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6acc15bb80 msgr2=0x7f6acc147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6acc15bb80 0x7f6acc147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/2860972845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc14dff0 con 0x7f6acc1553a0 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad1360640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc0c8070 0x7f6acc14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad1b61640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6acc15bb80 0x7f6acc147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc1553a0 0x7f6acc0c5210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6abc035040 tx=0x7f6abc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.585+0000 7f6ac1ffb640 1 -- 172.21.15.26:0/2860972845 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc037040 con 0x7f6acc1553a0 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.586+0000 7f6ac1ffb640 1 -- 172.21.15.26:0/2860972845 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc030770 con 0x7f6acc1553a0 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.586+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc15b040 con 0x7f6acc1553a0 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.586+0000 7f6ac1ffb640 1 -- 172.21.15.26:0/2860972845 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc030b80 con 0x7f6acc1553a0 2024-04-25T13:16:21.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.586+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc0c7310 con 0x7f6acc1553a0 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.588+0000 7f6ac1ffb640 1 -- 172.21.15.26:0/2860972845 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6abc044020 con 0x7f6acc1553a0 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.588+0000 7f6ac1ffb640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ab006c8f0 0x7f6ab006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.588+0000 7f6ac1ffb640 1 -- 172.21.15.26:0/2860972845 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6abc0ac2b0 con 0x7f6acc1553a0 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.588+0000 7f6ad1360640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ab006c8f0 0x7f6ab006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.589+0000 7f6ad63b0740 1 Processor -- start 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.589+0000 7f6ad1360640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ab006c8f0 0x7f6ab006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8006fd0 tx=0x7f6ac8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.589+0000 7f6ad63b0740 1 -- start start 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x56181591fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618158dafc0 0x5618158def40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618159298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561815844c50 con 0x5618158db690 2024-04-25T13:16:21.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618157e1830 con 0x5618158dafc0 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561815840c10 con 0x5618158dba70 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x56181591fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x56181591fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33666/0 (socket says 172.21.15.26:33666) 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 -- 172.21.15.26:0/874025165 learned_addr learned my addr 172.21.15.26:0/874025165 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1b61640 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618159298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618158dafc0 0x5618158def40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 -- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 msgr2=0x5618159298a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618159298a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 -- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618158dafc0 msgr2=0x5618158def40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618158dafc0 0x5618158def40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 -- 172.21.15.26:0/874025165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618155572d0 con 0x5618158db690 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ad1360640 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x56181591fa90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800fb30 tx=0x7f6ac8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9989fda77eb271f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ab6ffd640 1 -- 172.21.15.26:0/874025165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac801b050 con 0x5618158db690 2024-04-25T13:16:21.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ab6ffd640 1 -- 172.21.15.26:0/874025165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac8025070 con 0x5618158db690 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.590+0000 7f6ab6ffd640 1 -- 172.21.15.26:0/874025165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8020440 con 0x5618158db690 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 -- 172.21.15.26:0/874025165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 msgr2=0x56181591fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x56181591fa90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800fb30 tx=0x7f6ac8012000 comp rx=0 tx=0).stop 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 -- 172.21.15.26:0/874025165 shutdown_connections 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618159298a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618158dafc0 0x5618158def40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/874025165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x56181591fa90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 -- 172.21.15.26:0/874025165 >> 172.21.15.26:0/874025165 conn(0x5618158dcc80 msgr2=0x5618158df580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 -- 172.21.15.26:0/874025165 shutdown_connections 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.591+0000 7f6ad63b0740 1 -- 172.21.15.26:0/874025165 wait complete. 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.592+0000 7f6ad63b0740 1 -- start start 2024-04-25T13:16:21.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.592+0000 7f6ad63b0740 1 Processor -- start 2024-04-25T13:16:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618158e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x561815930f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561815920700 con 0x5618158db690 2024-04-25T13:16:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618157df470 con 0x561815902140 2024-04-25T13:16:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5618158de0e0 con 0x5618158dba70 2024-04-25T13:16:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad63b0740 10 client.0 _ll_register_callbacks cb 0x561815804f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33680/0 (socket says 172.21.15.26:33680) 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 -- 172.21.15.26:0/1922387497 learned_addr learned my addr 172.21.15.26:0/1922387497 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618158e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1b61640 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x561815930f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 -- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 msgr2=0x5618158e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618158e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 -- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 msgr2=0x561815930f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x561815930f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 -- 172.21.15.26:0/1922387497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618156216b0 con 0x5618158db690 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8014830 tx=0x7f6ac8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7233f4b39d39ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.593+0000 7f6aabfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6aabfff640 1 -- 172.21.15.26:0/1922387497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8020850 con 0x5618158db690 2024-04-25T13:16:21.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6aabfff640 1 -- 172.21.15.26:0/1922387497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6ac80209f0 con 0x5618158db690 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ac8025070 con 0x5618158db690 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6aabfff640 1 -- 172.21.15.26:0/1922387497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f6ac803c050 con 0x5618158db690 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 10 client.4467 fetch_fsmap learned FSMap version 7 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x561815922920 con 0x5618158db690 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6aabfff640 1 -- 172.21.15.26:0/1922387497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac8025070 con 0x5618158db690 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6aabfff640 1 -- 172.21.15.26:0/1922387497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f6ac803f020 con 0x5618158db690 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 10 client.4467 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 10 client.4467 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 20 client.4467 populate_metadata read hostname 'smithi026' 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x5618158fc7e0 0x56181593fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 4 client.4467 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 --> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561815852670 con 0x5618158fc7e0 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.594+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x5618158fc7e0 0x56181593fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.595+0000 7f6aabfff640 10 client.4467 ms_handle_connect on v2:172.21.15.169:6836/963417679 2024-04-25T13:16:21.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:21.595+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x5618158fc7e0 0x56181593fed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c29df00f13826974 server_cookie=dc4e6db550d3096f in_seq=0 out_seq=0 2024-04-25T13:16:24.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.254+0000 7f6aabfff640 1 -- 172.21.15.26:0/1922387497 <== mds.0 v2:172.21.15.169:6836/963417679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561815852670 con 0x5618158fc7e0 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.254+0000 7f6aabfff640 10 client.4467 handle_command_reply: tid=0 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.254+0000 7f6ad63b0740 1 client.4467 shutdown 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.254+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 msgr2=0x561815908f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8014830 tx=0x7f6ac8004730 comp rx=0 tx=0).stop 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 shutdown_connections 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x5618158fc7e0 0x56181593fed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x561815930f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x5618158e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1922387497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908f50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 >> 172.21.15.26:0/1922387497 conn(0x5618158dafc0 msgr2=0x5618158da1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6aabfff640 0 client.4467 ms_handle_reset on v2:172.21.15.169:6836/963417679 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 shutdown_connections 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1922387497 wait complete. 2024-04-25T13:16:24.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.255+0000 7f6ad63b0740 20 client.4467 trim_cache size 0 max 16384 2024-04-25T13:16:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.275+0000 7f6ad63b0740 1 Processor -- start 2024-04-25T13:16:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.275+0000 7f6ad63b0740 1 -- start start 2024-04-25T13:16:24.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x561815909230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618158ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1fd810 con 0x5618158db690 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561815920700 con 0x561815902140 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561815922ee0 con 0x5618158dba70 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40912/0 (socket says 172.21.15.26:40912) 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 -- 172.21.15.26:0/3899360700 learned_addr learned my addr 172.21.15.26:0/3899360700 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x561815909230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1b61640 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618158ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 -- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 msgr2=0x561815909230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x561815909230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 -- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 msgr2=0x5618158ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618158ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1360640 1 -- 172.21.15.26:0/3899360700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561815923750 con 0x5618158db690 2024-04-25T13:16:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x561815909230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.276+0000 7f6ad1b61640 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618158ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.277+0000 7f6ad1360640 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8020d60 tx=0x7f6ac802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d461e0e37a83680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.277+0000 7f6ab67fc640 1 -- 172.21.15.26:0/3899360700 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac801b070 con 0x5618158db690 2024-04-25T13:16:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.277+0000 7f6ab67fc640 1 -- 172.21.15.26:0/3899360700 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac8025040 con 0x5618158db690 2024-04-25T13:16:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.277+0000 7f6ab67fc640 1 -- 172.21.15.26:0/3899360700 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8020850 con 0x5618158db690 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 -- 172.21.15.26:0/3899360700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 msgr2=0x561815908cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8020d60 tx=0x7f6ac802d040 comp rx=0 tx=0).stop 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 -- 172.21.15.26:0/3899360700 shutdown_connections 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618158ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158dba70 0x561815909230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/3899360700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158db690 0x561815908cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 -- 172.21.15.26:0/3899360700 >> 172.21.15.26:0/3899360700 conn(0x5618158dafc0 msgr2=0x5618158d5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 -- 172.21.15.26:0/3899360700 shutdown_connections 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 -- 172.21.15.26:0/3899360700 wait complete. 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 -- start start 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.278+0000 7f6ad63b0740 1 Processor -- start 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.279+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158db690 0x56181591aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.279+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158dba70 0x56181592dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.279+0000 7f6ad63b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618159242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.279+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5618159344f0 con 0x5618158dba70 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.279+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618158fc660 con 0x561815902140 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.279+0000 7f6ad63b0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561815934b80 con 0x5618158db690 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.279+0000 7f6ad63b0740 10 client.0 _ll_register_callbacks cb 0x7f6abc009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158dba70 0x56181592dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158dba70 0x56181592dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40928/0 (socket says 172.21.15.26:40928) 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/1694177868 learned_addr learned my addr 172.21.15.26:0/1694177868 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad1b61640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618159242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158db690 0x56181591aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158db690 msgr2=0x56181591aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158db690 0x56181591aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 msgr2=0x5618159242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618159242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 -- 172.21.15.26:0/1694177868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181592d6a0 con 0x5618158dba70 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158db690 0x56181591aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad0b5f640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158dba70 0x56181592dd00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6abc000c00 tx=0x7f6abc0ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e9902c704cc63e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6aabfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6aabfff640 1 -- 172.21.15.26:0/1694177868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc03ae30 con 0x5618158dba70 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6aabfff640 1 -- 172.21.15.26:0/1694177868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6abc078030 con 0x5618158dba70 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.280+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ac8025040 con 0x5618158dba70 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6aabfff640 1 -- 172.21.15.26:0/1694177868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f6abc030d20 con 0x5618158dba70 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 10 client.4473 fetch_fsmap learned FSMap version 7 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x56181593a1b0 con 0x5618158dba70 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6aabfff640 1 -- 172.21.15.26:0/1694177868 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac8025040 con 0x5618158dba70 2024-04-25T13:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6aabfff640 1 -- 172.21.15.26:0/1694177868 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f6abc03a030 con 0x5618158dba70 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 10 client.4473 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 10 client.4473 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 20 client.4473 populate_metadata read hostname 'smithi026' 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 4 client.4473 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 --> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] -- command(tid 0: {"prefix": "status"}) -- 0x56181584c4e0 con 0x56181599f000 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.281+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6aabfff640 10 client.4473 ms_handle_connect on v2:172.21.15.169:6836/963417679 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e50e618a957893 server_cookie=f6fcc4fbbde1b454 in_seq=0 out_seq=0 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad1360640 1 -- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 msgr2=0x5618159a7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad1360640 1 -- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 msgr2=0x5618159a7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-25T13:16:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6aabfff640 10 client.4473 ms_handle_connect on v2:172.21.15.169:6836/963417679 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad1360640 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e50e618a957893 server_cookie=f6fcc4fbbde1b454 in_seq=0 out_seq=1 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6aabfff640 1 -- 172.21.15.26:0/1694177868 <== mds.0 v2:172.21.15.169:6836/963417679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x56181584c4e0 con 0x56181599f000 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6aabfff640 10 client.4473 handle_command_reply: tid=0 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.282+0000 7f6ad63b0740 1 client.4473 shutdown 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158dba70 msgr2=0x56181592dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158dba70 0x56181592dd00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6abc000c00 tx=0x7f6abc0ac040 comp rx=0 tx=0).stop 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 shutdown_connections 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x56181599f000 0x5618159a7b90 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561815902140 0x5618159242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5618158dba70 0x56181592dd00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 --2- 172.21.15.26:0/1694177868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5618158db690 0x56181591aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6aabfff640 0 client.4473 ms_handle_reset on v2:172.21.15.169:6836/963417679 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 >> 172.21.15.26:0/1694177868 conn(0x5618158dafc0 msgr2=0x5618158de100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 shutdown_connections 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 1 -- 172.21.15.26:0/1694177868 wait complete. 2024-04-25T13:16:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.283+0000 7f6ad63b0740 20 client.4473 trim_cache size 0 max 16384 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8f4a7b84-1cd1-4957-a762-8e7959ae0a88", 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4308, 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 14.059832797, 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 6, 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 24, 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T13:16:24.288 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 21.538663308 2024-04-25T13:16:24.289 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:16:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ab006c8f0 msgr2=0x7f6ab006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ab006c8f0 0x7f6ab006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8006fd0 tx=0x7f6ac8008040 comp rx=0 tx=0).stop 2024-04-25T13:16:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc1553a0 msgr2=0x7f6acc0c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc1553a0 0x7f6acc0c5210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6abc035040 tx=0x7f6abc0046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 shutdown_connections 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6ab006c8f0 0x7f6ab006edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6acc15bb80 0x7f6acc147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6acc1553a0 0x7f6acc0c5210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 --2- 172.21.15.26:0/2860972845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6acc0c8070 0x7f6acc14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 >> 172.21.15.26:0/2860972845 conn(0x7f6acc073010 msgr2=0x7f6acc0c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 shutdown_connections 2024-04-25T13:16:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.284+0000 7f6ad35c4640 1 -- 172.21.15.26:0/2860972845 wait complete. 2024-04-25T13:16:24.297 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:16:24.297 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:24.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:16:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.405+0000 7f8748c20640 1 Processor -- start 2024-04-25T13:16:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.405+0000 7f8748c20640 1 -- start start 2024-04-25T13:16:24.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f8748c20640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87441554e0 0x7f874415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f8748c20640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87441558c0 con 0x7f87440d08a0 2024-04-25T13:16:24.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f8748c20640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874415f630 con 0x7f87440b3c00 2024-04-25T13:16:24.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f8748c20640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f87440b4a80 con 0x7f87441554e0 2024-04-25T13:16:24.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f874259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87441554e0 0x7f874415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f8742d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f87440d08a0 0x7f8744165a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36892/0 (socket says 172.21.15.26:36892) 2024-04-25T13:16:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f8742d9d640 1 -- 172.21.15.26:0/3204455400 learned_addr learned my addr 172.21.15.26:0/3204455400 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f874259c640 1 -- 172.21.15.26:0/3204455400 >> v1:172.21.15.169:6789/0 conn(0x7f87440b3c00 legacy=0x7f87440b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f874259c640 1 -- 172.21.15.26:0/3204455400 >> v1:172.21.15.26:6789/0 conn(0x7f87440d08a0 legacy=0x7f8744165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f8741d9b640 1 -- 172.21.15.26:0/3204455400 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566442179 0 0) 0x7f873c001490 con 0x7f87440d08a0 2024-04-25T13:16:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.406+0000 7f874259c640 1 -- 172.21.15.26:0/3204455400 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87440cb8c0 con 0x7f87441554e0 2024-04-25T13:16:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.407+0000 7f874259c640 1 --2- 172.21.15.26:0/3204455400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87441554e0 0x7f874415f0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87440b4c00 tx=0x7f873402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a17d3859c66c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.407+0000 7f8741d9b640 1 -- 172.21.15.26:0/3204455400 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734037070 con 0x7f87441554e0 2024-04-25T13:16:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.407+0000 7f8741d9b640 1 -- 172.21.15.26:0/3204455400 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8734032640 con 0x7f87441554e0 2024-04-25T13:16:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.407+0000 7f8741d9b640 1 -- 172.21.15.26:0/3204455400 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734032a10 con 0x7f87441554e0 2024-04-25T13:16:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.408+0000 7f8748c20640 1 -- 172.21.15.26:0/3204455400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87441554e0 msgr2=0x7f874415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.408+0000 7f8748c20640 1 --2- 172.21.15.26:0/3204455400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87441554e0 0x7f874415f0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87440b4c00 tx=0x7f873402a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.408+0000 7f8748c20640 1 -- 172.21.15.26:0/3204455400 shutdown_connections 2024-04-25T13:16:24.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.408+0000 7f8748c20640 1 --2- 172.21.15.26:0/3204455400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87441554e0 0x7f874415f0f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.408+0000 7f8748c20640 1 -- 172.21.15.26:0/3204455400 >> 172.21.15.26:0/3204455400 conn(0x7f8744074d50 msgr2=0x7f8744075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.408+0000 7f8748c20640 1 -- 172.21.15.26:0/3204455400 shutdown_connections 2024-04-25T13:16:24.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.408+0000 7f8748c20640 1 -- 172.21.15.26:0/3204455400 wait complete. 2024-04-25T13:16:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.409+0000 7f8748c20640 1 Processor -- start 2024-04-25T13:16:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.409+0000 7f8748c20640 1 -- start start 2024-04-25T13:16:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8748c20640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87440b3c00 0x7f874415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8748c20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87440d08a0 0x7f87441e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8748c20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87441554e0 0x7f87440c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8748c20640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f87440b4430 con 0x7f87440b3c00 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8748c20640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f87440b4150 con 0x7f87441554e0 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8748c20640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f87440b4710 con 0x7f87440d08a0 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87440b3c00 0x7f874415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87440b3c00 0x7f874415ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40940/0 (socket says 172.21.15.26:40940) 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 -- 172.21.15.26:0/3671763492 learned_addr learned my addr 172.21.15.26:0/3671763492 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f873bfff640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87440d08a0 0x7f87441e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8742d9d640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87441554e0 0x7f87440c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 -- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87440d08a0 msgr2=0x7f87441e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87440d08a0 0x7f87441e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 -- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87441554e0 msgr2=0x7f87440c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87441554e0 0x7f87440c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 -- 172.21.15.26:0/3671763492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87440c7220 con 0x7f87440b3c00 2024-04-25T13:16:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f873bfff640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87440d08a0 0x7f87441e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f8742d9d640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87441554e0 0x7f87440c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.410+0000 7f874259c640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87440b3c00 0x7f874415ef30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8734000c00 tx=0x7f87340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.411+0000 7f873affd640 1 -- 172.21.15.26:0/3671763492 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734041020 con 0x7f87440b3c00 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.411+0000 7f873affd640 1 -- 172.21.15.26:0/3671763492 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8734030990 con 0x7f87440b3c00 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.411+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874415cdf0 con 0x7f87440b3c00 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.411+0000 7f873affd640 1 -- 172.21.15.26:0/3671763492 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734037040 con 0x7f87440b3c00 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.411+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874415d3b0 con 0x7f87440b3c00 2024-04-25T13:16:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.412+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874415da00 con 0x7f87440b3c00 2024-04-25T13:16:24.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.412+0000 7f873affd640 1 -- 172.21.15.26:0/3671763492 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8734044020 con 0x7f87440b3c00 2024-04-25T13:16:24.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.413+0000 7f873affd640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f872406c8f0 0x7f872406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.413+0000 7f873affd640 1 -- 172.21.15.26:0/3671763492 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f87340ac770 con 0x7f87440b3c00 2024-04-25T13:16:24.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.413+0000 7f873bfff640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f872406c8f0 0x7f872406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.413+0000 7f873bfff640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f872406c8f0 0x7f872406edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8744158d80 tx=0x7f872c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.417+0000 7f873affd640 1 -- 172.21.15.26:0/3671763492 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f873404b030 con 0x7f87440b3c00 2024-04-25T13:16:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.642+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8744069730 con 0x7f87440b3c00 2024-04-25T13:16:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.642+0000 7f873affd640 1 -- 172.21.15.26:0/3671763492 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f8744069730 con 0x7f87440b3c00 2024-04-25T13:16:24.642 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:16:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f872406c8f0 msgr2=0x7f872406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f872406c8f0 0x7f872406edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8744158d80 tx=0x7f872c009040 comp rx=0 tx=0).stop 2024-04-25T13:16:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87440b3c00 msgr2=0x7f874415ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87440b3c00 0x7f874415ef30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8734000c00 tx=0x7f87340046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 shutdown_connections 2024-04-25T13:16:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f872406c8f0 0x7f872406edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87441554e0 0x7f87440c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87440d08a0 0x7f87441e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 --2- 172.21.15.26:0/3671763492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87440b3c00 0x7f874415ef30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 >> 172.21.15.26:0/3671763492 conn(0x7f8744074d50 msgr2=0x7f8744153430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 shutdown_connections 2024-04-25T13:16:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24.644+0000 7f8748c20640 1 -- 172.21.15.26:0/3671763492 wait complete. 2024-04-25T13:16:24.654 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T13:16:24.654 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:16:24.654 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-04-25T13:16:24.655 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T13:16:24.655 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:24.655 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T13:16:24.655 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:16:24.655 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:16:24.655 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:16:24.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:24.655 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-04-25T13:16:24.670 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42688sec preferred_lft 42688sec 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link noprefixroute 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-04-25T13:16:24.672 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:16:24.673 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:24.673 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:16:24.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:16:24.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2024-04-25T13:16:24.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2024-04-25T13:16:24.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:16:24.673 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:16:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:24.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:24.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:24.857 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:16:24.880 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-04-25T13:16:24.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:24.882 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-04-25T13:16:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-04-25T13:16:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:16:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T13:16:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T13:16:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:16:24.950 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:24.951 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:16:24.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T13:16:24.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T13:16:24.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T13:16:24.951 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:16:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:25.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:25.234 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-25T13:16:25.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:25.249 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-04-25T13:16:25.304 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:25.304 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:16:25.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:25.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T13:16:25.304 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:16:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:25.424 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T13:16:25.424 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:16:25.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:25.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:25.553 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:25.553 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:16:25.553 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-04-25T13:16:25.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:16:25.554 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:16:25.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:25.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:25.631 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T13:16:25.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:16:25.632 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:25.647 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:16:25.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:16:25.648 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:25.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-25T13:16:25.769 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:16:25.825 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-25T13:16:25.825 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-25T13:16:25.825 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-25T13:16:25.825 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-25T13:16:25.825 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-25T13:16:25.825 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/selinux 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-25T13:16:25.826 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:25.827 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:25.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:25.828 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-25T13:16:25.883 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:16:25.883 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T13:16:25.926 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-25T13:16:25.950 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-25T13:16:26.005 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/selinux 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:16:26.006 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:26.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:26.007 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-25T13:16:26.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:2024-04-25T13:16:26.045+0000 7f34d7e0d480 -1 init, newargv = 0x556c85611010 newargc=15 2024-04-25T13:16:26.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[41187]: starting ceph client 2024-04-25T13:16:26.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[41187]: starting fuse 2024-04-25T13:16:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:43 2024-04-25T13:16:26.062 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T13:16:26.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> import re 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> import os 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:16:26.063 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> return f 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.admin")) 2024-04-25T13:16:26.064 DEBUG:teuthology.orchestra.run.smithi026:> ' 2024-04-25T13:16:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.admin.41187.asok 2024-04-25T13:16:26.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:26.193 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41187.asok 2024-04-25T13:16:26.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:26.193 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41187.asok status 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "admin", 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "41187", 2024-04-25T13:16:26.342 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4488, 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4488 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3455008336 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-25T13:16:26.343 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3455008336 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4488 192.168.0.1:0/3455008336", 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/3455008336", 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 6, 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 24, 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2024-04-25T13:16:26.344 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:16:26.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:26.352 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2024-04-25T13:16:26.352 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:26.367 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2024-04-25T13:16:26.367 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:26.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:26.368 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:26.433 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T13:16:26.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:16:26.544 INFO:teuthology.orchestra.run.smithi026.stdout:# file: . 2024-04-25T13:16:26.544 INFO:teuthology.orchestra.run.smithi026.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T13:16:26.545 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:26.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:26.551 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:16:26.551 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:16:26.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:26.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.705+0000 7f5a18f87640 1 Processor -- start 2024-04-25T13:16:26.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.705+0000 7f5a18f87640 1 -- start start 2024-04-25T13:16:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.706+0000 7f5a18f87640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 0x7f5a14071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.706+0000 7f5a18f87640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a140c7bd0 con 0x7f5a140c6e00 2024-04-25T13:16:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.706+0000 7f5a18f87640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a140c86a0 con 0x7f5a14074410 2024-04-25T13:16:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.706+0000 7f5a18f87640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a140c8980 con 0x7f5a14152fd0 2024-04-25T13:16:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.706+0000 7f5a12d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5a140c6e00 0x7f5a141636c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36898/0 (socket says 172.21.15.26:36898) 2024-04-25T13:16:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.706+0000 7f5a12d9d640 1 -- 172.21.15.26:0/86209240 learned_addr learned my addr 172.21.15.26:0/86209240 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1259c640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 0x7f5a14071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035560926 0 0) 0x7f5a140c7bd0 con 0x7f5a140c6e00 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a00003520 con 0x7f5a140c6e00 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3584553237 0 0) 0x7f5a00003520 con 0x7f5a140c6e00 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 msgr2=0x7f5a14071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 0x7f5a14071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 >> v1:172.21.15.169:6789/0 conn(0x7f5a14074410 legacy=0x7f5a14073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1415c3d0 con 0x7f5a140c6e00 2024-04-25T13:16:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f5a040019f0 con 0x7f5a140c6e00 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 >> v1:172.21.15.26:6789/0 conn(0x7f5a140c6e00 legacy=0x7f5a141636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a000039e0 0x7f5a00003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 0x7f5a00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a00004d40 0x7f5a000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5a140c8980 con 0x7f5a00004d40 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0000b9c0 con 0x7f5a000039e0 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0000bbc0 con 0x7f5a14152fd0 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a12d9d640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a00004d40 0x7f5a000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a1259c640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a000039e0 0x7f5a00003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.707+0000 7f5a11d9b640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 0x7f5a00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a12d9d640 1 -- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 msgr2=0x7f5a00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a12d9d640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a14152fd0 0x7f5a00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a12d9d640 1 -- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a000039e0 msgr2=0x7f5a00003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a12d9d640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a000039e0 0x7f5a00003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a12d9d640 1 -- 172.21.15.26:0/86209240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a00003520 con 0x7f5a00004d40 2024-04-25T13:16:26.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a12d9d640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a00004d40 0x7f5a000051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400a880 tx=0x7f5a00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663faeaaa4cb6de9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400a4a0 con 0x7f5a00004d40 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0402f070 con 0x7f5a00004d40 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.708+0000 7f5a1159a640 1 -- 172.21.15.26:0/86209240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0402bce0 con 0x7f5a00004d40 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.709+0000 7f5a18f87640 1 -- 172.21.15.26:0/86209240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a00004d40 msgr2=0x7f5a000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.709+0000 7f5a18f87640 1 --2- 172.21.15.26:0/86209240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a00004d40 0x7f5a000051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400a880 tx=0x7f5a00005830 comp rx=0 tx=0).stop 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.709+0000 7f5a12d9d640 1 -- 172.21.15.26:0/86209240 reap_dead start 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.709+0000 7f5a18f87640 1 -- 172.21.15.26:0/86209240 shutdown_connections 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.709+0000 7f5a18f87640 1 -- 172.21.15.26:0/86209240 >> 172.21.15.26:0/86209240 conn(0x7f5a140c8f00 msgr2=0x7f5a140c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.709+0000 7f5a18f87640 1 -- 172.21.15.26:0/86209240 shutdown_connections 2024-04-25T13:16:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.709+0000 7f5a18f87640 1 -- 172.21.15.26:0/86209240 wait complete. 2024-04-25T13:16:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.710+0000 7f5a18f87640 1 Processor -- start 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.710+0000 7f5a18f87640 1 -- start start 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a18f87640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a00004d40 0x7f5a141f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a18f87640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a141e2f20 0x7f5a141eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a18f87640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a141e4480 0x7f5a1406e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a18f87640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5a140c8c60 con 0x7f5a141e4480 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a18f87640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1415c990 con 0x7f5a141e2f20 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a18f87640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a141533b0 con 0x7f5a00004d40 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a141e4480 0x7f5a1406e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a141e4480 0x7f5a1406e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40964/0 (socket says 172.21.15.26:40964) 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 -- 172.21.15.26:0/1692995233 learned_addr learned my addr 172.21.15.26:0/1692995233 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a1259c640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a00004d40 0x7f5a141f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a11d9b640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a141e2f20 0x7f5a141eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 -- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a00004d40 msgr2=0x7f5a141f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a00004d40 0x7f5a141f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 -- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a141e2f20 msgr2=0x7f5a141eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a141e2f20 0x7f5a141eeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a12d9d640 1 -- 172.21.15.26:0/1692995233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a141ef530 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.711+0000 7f5a1259c640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a00004d40 0x7f5a141f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.712+0000 7f5a12d9d640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a141e4480 0x7f5a1406e640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5a0402b530 tx=0x7f5a14073650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.712+0000 7f5a0affd640 1 -- 172.21.15.26:0/1692995233 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400a4a0 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.712+0000 7f5a0affd640 1 -- 172.21.15.26:0/1692995233 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a040019e0 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.712+0000 7f5a0affd640 1 -- 172.21.15.26:0/1692995233 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04004da0 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.712+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a14159a00 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.712+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a141ee7f0 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.713+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a14159f20 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.713+0000 7f5a0affd640 1 -- 172.21.15.26:0/1692995233 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a04034470 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.714+0000 7f5a0affd640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f59f406c8f0 0x7f59f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.714+0000 7f5a0affd640 1 -- 172.21.15.26:0/1692995233 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5a040ac0a0 con 0x7f5a141e4480 2024-04-25T13:16:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.714+0000 7f5a1259c640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f59f406c8f0 0x7f59f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.715+0000 7f5a1259c640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f59f406c8f0 0x7f59f406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009bc0 tx=0x7f5a0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:26.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.718+0000 7f5a0affd640 1 -- 172.21.15.26:0/1692995233 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a0407a100 con 0x7f5a141e4480 2024-04-25T13:16:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.902+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a141ee5e0 con 0x7f5a141e4480 2024-04-25T13:16:26.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.903+0000 7f5a0affd640 1 -- 172.21.15.26:0/1692995233 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f5a04079a00 con 0x7f5a141e4480 2024-04-25T13:16:26.904 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:26.905 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f59f406c8f0 msgr2=0x7f59f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f59f406c8f0 0x7f59f406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009bc0 tx=0x7f5a0c008040 comp rx=0 tx=0).stop 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a141e4480 msgr2=0x7f5a1406e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a141e4480 0x7f5a1406e640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5a0402b530 tx=0x7f5a14073650 comp rx=0 tx=0).stop 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 shutdown_connections 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f59f406c8f0 0x7f59f406edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a141e4480 0x7f5a1406e640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a141e2f20 0x7f5a141eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.905+0000 7f5a18f87640 1 --2- 172.21.15.26:0/1692995233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a00004d40 0x7f5a141f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.906+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 >> 172.21.15.26:0/1692995233 conn(0x7f5a140c8f00 msgr2=0x7f5a140c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.906+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 shutdown_connections 2024-04-25T13:16:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:26.906+0000 7f5a18f87640 1 -- 172.21.15.26:0/1692995233 wait complete. 2024-04-25T13:16:26.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:07.306201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:08.537870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:12.230813+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:26.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.020+0000 7f1d3f259640 1 Processor -- start 2024-04-25T13:16:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.020+0000 7f1d3f259640 1 -- start start 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.021+0000 7f1d3f259640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.021+0000 7f1d3f259640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3815eaa0 con 0x7f1d3806c880 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.021+0000 7f1d3f259640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3815ed80 con 0x7f1d38155710 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.021+0000 7f1d3f259640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1d380c8940 con 0x7f1d380c7c20 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.021+0000 7f1d37fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1d3806c880 0x7f1d3806ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36904/0 (socket says 172.21.15.26:36904) 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.021+0000 7f1d37fff640 1 -- 172.21.15.26:0/4205303500 learned_addr learned my addr 172.21.15.26:0/4205303500 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d3d7f6640 1 --2- 172.21.15.26:0/4205303500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031901919 0 0) 0x7f1d3815eaa0 con 0x7f1d3806c880 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d20003520 con 0x7f1d3806c880 2024-04-25T13:16:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128761912 0 0) 0x7f1d3815ed80 con 0x7f1d38155710 2024-04-25T13:16:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d3815eaa0 con 0x7f1d38155710 2024-04-25T13:16:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1622238557 0 0) 0x7f1d20003520 con 0x7f1d3806c880 2024-04-25T13:16:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d3d7f6640 1 -- 172.21.15.26:0/4205303500 >> v1:172.21.15.169:6789/0 conn(0x7f1d38155710 legacy=0x7f1d380cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d3d7f6640 1 -- 172.21.15.26:0/4205303500 >> v1:172.21.15.26:6789/0 conn(0x7f1d3806c880 legacy=0x7f1d3806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.022+0000 7f1d3d7f6640 1 -- 172.21.15.26:0/4205303500 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3815f060 con 0x7f1d380c7c20 2024-04-25T13:16:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3d7f6640 1 --2- 172.21.15.26:0/4205303500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c80d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009dc0 tx=0x7f1d3002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72370dc0aff5388b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c001670 con 0x7f1d380c7c20 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d30007540 con 0x7f1d380c7c20 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d377fe640 1 -- 172.21.15.26:0/4205303500 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300078f0 con 0x7f1d380c7c20 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3f259640 1 -- 172.21.15.26:0/4205303500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 msgr2=0x7f1d380c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3f259640 1 --2- 172.21.15.26:0/4205303500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c80d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009dc0 tx=0x7f1d3002a660 comp rx=0 tx=0).stop 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3f259640 1 -- 172.21.15.26:0/4205303500 shutdown_connections 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3f259640 1 --2- 172.21.15.26:0/4205303500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c80d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3f259640 1 -- 172.21.15.26:0/4205303500 >> 172.21.15.26:0/4205303500 conn(0x7f1d380731d0 msgr2=0x7f1d380735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3f259640 1 -- 172.21.15.26:0/4205303500 shutdown_connections 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.023+0000 7f1d3f259640 1 -- 172.21.15.26:0/4205303500 wait complete. 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 Processor -- start 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 -- start start 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3806c880 0x7f1d3814eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d38155710 0x7f1d380c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3815f6b0 con 0x7f1d3806c880 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d38155af0 con 0x7f1d38155710 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.025+0000 7f1d3f259640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1d380c8610 con 0x7f1d380c7c20 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3806c880 0x7f1d3814eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3806c880 0x7f1d3814eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40974/0 (socket says 172.21.15.26:40974) 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 -- 172.21.15.26:0/1575699753 learned_addr learned my addr 172.21.15.26:0/1575699753 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d37fff640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3d7f6640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d38155710 0x7f1d380c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 -- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 msgr2=0x7f1d380c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 -- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d38155710 msgr2=0x7f1d380c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d38155710 0x7f1d380c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 -- 172.21.15.26:0/1575699753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d38159240 con 0x7f1d3806c880 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3cff5640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3806c880 0x7f1d3814eeb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c460 tx=0x7f1d2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d357fa640 1 -- 172.21.15.26:0/1575699753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280052d0 con 0x7f1d3806c880 2024-04-25T13:16:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d357fa640 1 -- 172.21.15.26:0/1575699753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d28005490 con 0x7f1d3806c880 2024-04-25T13:16:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d38159520 con 0x7f1d3806c880 2024-04-25T13:16:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d357fa640 1 -- 172.21.15.26:0/1575699753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28012870 con 0x7f1d3806c880 2024-04-25T13:16:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.026+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3815b170 con 0x7f1d3806c880 2024-04-25T13:16:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.027+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3815aca0 con 0x7f1d3806c880 2024-04-25T13:16:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.028+0000 7f1d357fa640 1 -- 172.21.15.26:0/1575699753 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d28012a10 con 0x7f1d3806c880 2024-04-25T13:16:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.028+0000 7f1d357fa640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1d2406c8f0 0x7f1d2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.028+0000 7f1d357fa640 1 -- 172.21.15.26:0/1575699753 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1d2808bab0 con 0x7f1d3806c880 2024-04-25T13:16:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.029+0000 7f1d37fff640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1d2406c8f0 0x7f1d2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.029+0000 7f1d37fff640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1d2406c8f0 0x7f1d2406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d38154750 tx=0x7f1d2c001690 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.033+0000 7f1d357fa640 1 -- 172.21.15.26:0/1575699753 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d28059b10 con 0x7f1d3806c880 2024-04-25T13:16:27.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.217+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1d38068f50 con 0x7f1d3806c880 2024-04-25T13:16:27.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.218+0000 7f1d357fa640 1 -- 172.21.15.26:0/1575699753 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f1d28059410 con 0x7f1d3806c880 2024-04-25T13:16:27.219 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.219+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1d2406c8f0 msgr2=0x7f1d2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.219+0000 7f1d3f259640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1d2406c8f0 0x7f1d2406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d38154750 tx=0x7f1d2c001690 comp rx=0 tx=0).stop 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3806c880 msgr2=0x7f1d3814eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3806c880 0x7f1d3814eeb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c460 tx=0x7f1d2800c920 comp rx=0 tx=0).stop 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 shutdown_connections 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1d2406c8f0 0x7f1d2406edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d38155710 0x7f1d380c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d380c7c20 0x7f1d380c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 --2- 172.21.15.26:0/1575699753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3806c880 0x7f1d3814eeb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 >> 172.21.15.26:0/1575699753 conn(0x7f1d380731d0 msgr2=0x7f1d38153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 shutdown_connections 2024-04-25T13:16:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.220+0000 7f1d3f259640 1 -- 172.21.15.26:0/1575699753 wait complete. 2024-04-25T13:16:27.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:27.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.334+0000 7fdfcfa3a640 1 Processor -- start 2024-04-25T13:16:27.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.335+0000 7fdfcfa3a640 1 -- start start 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.335+0000 7fdfcfa3a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdfc8155250 0x7fdfc80cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.335+0000 7fdfcfa3a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc815b340 con 0x7fdfc80710a0 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.335+0000 7fdfcfa3a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc815b620 con 0x7fdfc80cb870 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.335+0000 7fdfcfa3a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc815b900 con 0x7fdfc8155250 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfcdfd7640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdfc80710a0 0x7fdfc80714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36910/0 (socket says 172.21.15.26:36910) 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfcdfd7640 1 -- 172.21.15.26:0/1707211789 learned_addr learned my addr 172.21.15.26:0/1707211789 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfcd7d6640 1 --2- 172.21.15.26:0/1707211789 >> v2:172.21.15.169:3300/0 conn(0x7fdfc8155250 0x7fdfc80cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfc7fff640 1 -- 172.21.15.26:0/1707211789 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264122180 0 0) 0x7fdfc815b340 con 0x7fdfc80710a0 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfc7fff640 1 -- 172.21.15.26:0/1707211789 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb0003520 con 0x7fdfc80710a0 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfc7fff640 1 -- 172.21.15.26:0/1707211789 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3609389038 0 0) 0x7fdfb0003520 con 0x7fdfc80710a0 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfcd7d6640 1 -- 172.21.15.26:0/1707211789 >> v1:172.21.15.169:6789/0 conn(0x7fdfc80cb870 legacy=0x7fdfc815eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfcd7d6640 1 -- 172.21.15.26:0/1707211789 >> v1:172.21.15.26:6789/0 conn(0x7fdfc80710a0 legacy=0x7fdfc80714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.336+0000 7fdfcd7d6640 1 -- 172.21.15.26:0/1707211789 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc815bbe0 con 0x7fdfc8155250 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.337+0000 7fdfcd7d6640 1 --2- 172.21.15.26:0/1707211789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8155250 0x7fdfc80cb330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00097a0 tx=0x7fdfc002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4166f9429985668 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.337+0000 7fdfc7fff640 1 -- 172.21.15.26:0/1707211789 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0037070 con 0x7fdfc8155250 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.337+0000 7fdfc7fff640 1 -- 172.21.15.26:0/1707211789 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc002ace0 con 0x7fdfc8155250 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.337+0000 7fdfc7fff640 1 -- 172.21.15.26:0/1707211789 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80019f0 con 0x7fdfc8155250 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.338+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/1707211789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8155250 msgr2=0x7fdfc80cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.338+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/1707211789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8155250 0x7fdfc80cb330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00097a0 tx=0x7fdfc002a250 comp rx=0 tx=0).stop 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.338+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/1707211789 shutdown_connections 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.338+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/1707211789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8155250 0x7fdfc80cb330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.338+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/1707211789 >> 172.21.15.26:0/1707211789 conn(0x7fdfc8074f30 msgr2=0x7fdfc8075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.338+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/1707211789 shutdown_connections 2024-04-25T13:16:27.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.338+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/1707211789 wait complete. 2024-04-25T13:16:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.339+0000 7fdfcfa3a640 1 Processor -- start 2024-04-25T13:16:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.339+0000 7fdfcfa3a640 1 -- start start 2024-04-25T13:16:27.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcfa3a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc80710a0 0x7fdfc80cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcfa3a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc80cb870 0x7fdfc80ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcfa3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc8155250 0x7fdfc81f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcfa3a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8155630 con 0x7fdfc8155250 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcfa3a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc815b010 con 0x7fdfc80710a0 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcfa3a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc806c3a0 con 0x7fdfc80cb870 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc8155250 0x7fdfc81f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc8155250 0x7fdfc81f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40982/0 (socket says 172.21.15.26:40982) 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcd7d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc80710a0 0x7fdfc80cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 -- 172.21.15.26:0/3373365109 learned_addr learned my addr 172.21.15.26:0/3373365109 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfccfd5640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc80cb870 0x7fdfc80ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 -- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc80cb870 msgr2=0x7fdfc80ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc80cb870 0x7fdfc80ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 -- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc80710a0 msgr2=0x7fdfc80cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc80710a0 0x7fdfc80cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 -- 172.21.15.26:0/3373365109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc80ce030 con 0x7fdfc8155250 2024-04-25T13:16:27.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcdfd7640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc8155250 0x7fdfc81f4480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800cc30 tx=0x7fdfb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfc5ffb640 1 -- 172.21.15.26:0/3373365109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8017070 con 0x7fdfc8155250 2024-04-25T13:16:27.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfc5ffb640 1 -- 172.21.15.26:0/3373365109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb800ce40 con 0x7fdfc8155250 2024-04-25T13:16:27.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc80c7d10 con 0x7fdfc8155250 2024-04-25T13:16:27.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.340+0000 7fdfc5ffb640 1 -- 172.21.15.26:0/3373365109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8012640 con 0x7fdfc8155250 2024-04-25T13:16:27.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.341+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc80c82d0 con 0x7fdfc8155250 2024-04-25T13:16:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.342+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8068e40 con 0x7fdfc8155250 2024-04-25T13:16:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.342+0000 7fdfc5ffb640 1 -- 172.21.15.26:0/3373365109 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfb801a070 con 0x7fdfc8155250 2024-04-25T13:16:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.342+0000 7fdfc5ffb640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdfb406c920 0x7fdfb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.343+0000 7fdfc5ffb640 1 -- 172.21.15.26:0/3373365109 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdfb808bd80 con 0x7fdfc8155250 2024-04-25T13:16:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.343+0000 7fdfcd7d6640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdfb406c920 0x7fdfb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.343+0000 7fdfcd7d6640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdfb406c920 0x7fdfb406ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0034000 tx=0x7fdfc002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.347+0000 7fdfc5ffb640 1 -- 172.21.15.26:0/3373365109 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfb80596f0 con 0x7fdfc8155250 2024-04-25T13:16:27.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.529+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdfc8071be0 con 0x7fdfc8155250 2024-04-25T13:16:27.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.530+0000 7fdfc5ffb640 1 -- 172.21.15.26:0/3373365109 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fdfb805d9f0 con 0x7fdfc8155250 2024-04-25T13:16:27.530 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:16:27.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.531+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdfb406c920 msgr2=0x7fdfb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.531+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdfb406c920 0x7fdfb406ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0034000 tx=0x7fdfc002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.531+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc8155250 msgr2=0x7fdfc81f4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.531+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc8155250 0x7fdfc81f4480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800cc30 tx=0x7fdfb800a430 comp rx=0 tx=0).stop 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.531+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 shutdown_connections 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.531+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdfb406c920 0x7fdfb406ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.532+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc8155250 0x7fdfc81f4480 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.532+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc80cb870 0x7fdfc80ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.532+0000 7fdfcfa3a640 1 --2- 172.21.15.26:0/3373365109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc80710a0 0x7fdfc80cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.532+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 >> 172.21.15.26:0/3373365109 conn(0x7fdfc8074f30 msgr2=0x7fdfc815eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.532+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 shutdown_connections 2024-04-25T13:16:27.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.532+0000 7fdfcfa3a640 1 -- 172.21.15.26:0/3373365109 wait complete. 2024-04-25T13:16:27.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:27.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.645+0000 7efc45f43640 1 Processor -- start 2024-04-25T13:16:27.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.645+0000 7efc45f43640 1 -- start start 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc45f43640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc40154f00 0x7efc40073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc45f43640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4015be60 con 0x7efc400b3600 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc45f43640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4015e650 con 0x7efc400cc710 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc45f43640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7efc4015e930 con 0x7efc40154f00 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc3f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc40154f00 0x7efc40073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc3effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efc400b3600 0x7efc400cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36924/0 (socket says 172.21.15.26:36924) 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc3f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc40154f00 0x7efc40073110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40988/0 (socket says 172.21.15.26:40988) 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.646+0000 7efc3effd640 1 -- 172.21.15.26:0/1223982136 learned_addr learned my addr 172.21.15.26:0/1223982136 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.647+0000 7efc3f7fe640 1 -- 172.21.15.26:0/1223982136 >> v1:172.21.15.169:6789/0 conn(0x7efc400cc710 legacy=0x7efc40165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.647+0000 7efc3f7fe640 1 -- 172.21.15.26:0/1223982136 >> v1:172.21.15.26:6789/0 conn(0x7efc400b3600 legacy=0x7efc400cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.647+0000 7efc3e7fc640 1 -- 172.21.15.26:0/1223982136 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380176506 0 0) 0x7efc4015be60 con 0x7efc400b3600 2024-04-25T13:16:27.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.647+0000 7efc3f7fe640 1 -- 172.21.15.26:0/1223982136 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4015ec10 con 0x7efc40154f00 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.647+0000 7efc3f7fe640 1 --2- 172.21.15.26:0/1223982136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc40154f00 0x7efc40073110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efc300097a0 tx=0x7efc3002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d989a5a454d2b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc3e7fc640 1 -- 172.21.15.26:0/1223982136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30037070 con 0x7efc40154f00 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc3e7fc640 1 -- 172.21.15.26:0/1223982136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30032440 con 0x7efc40154f00 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc3e7fc640 1 -- 172.21.15.26:0/1223982136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30032810 con 0x7efc40154f00 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc45f43640 1 -- 172.21.15.26:0/1223982136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc40154f00 msgr2=0x7efc40073110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc45f43640 1 --2- 172.21.15.26:0/1223982136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc40154f00 0x7efc40073110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efc300097a0 tx=0x7efc3002a230 comp rx=0 tx=0).stop 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc45f43640 1 -- 172.21.15.26:0/1223982136 shutdown_connections 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc45f43640 1 --2- 172.21.15.26:0/1223982136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc40154f00 0x7efc40073110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc45f43640 1 -- 172.21.15.26:0/1223982136 >> 172.21.15.26:0/1223982136 conn(0x7efc40068570 msgr2=0x7efc40071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc45f43640 1 -- 172.21.15.26:0/1223982136 shutdown_connections 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.648+0000 7efc45f43640 1 -- 172.21.15.26:0/1223982136 wait complete. 2024-04-25T13:16:27.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.649+0000 7efc45f43640 1 Processor -- start 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc45f43640 1 -- start start 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc45f43640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc400b3600 0x7efc401499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc45f43640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc400cc710 0x7efc40153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc45f43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc40154f00 0x7efc40153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc45f43640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efc401552e0 con 0x7efc400cc710 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc45f43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efc400cb230 con 0x7efc40154f00 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc45f43640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efc400cf060 con 0x7efc400b3600 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc3effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc400cc710 0x7efc40153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc3effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc400cc710 0x7efc40153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41004/0 (socket says 172.21.15.26:41004) 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.650+0000 7efc3effd640 1 -- 172.21.15.26:0/371582374 learned_addr learned my addr 172.21.15.26:0/371582374 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3f7fe640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc400b3600 0x7efc401499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3ffff640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc40154f00 0x7efc40153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3effd640 1 -- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc400b3600 msgr2=0x7efc401499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3effd640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc400b3600 0x7efc401499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3effd640 1 -- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc40154f00 msgr2=0x7efc40153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3effd640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc40154f00 0x7efc40153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3effd640 1 -- 172.21.15.26:0/371582374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc401f1660 con 0x7efc400cc710 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3ffff640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc40154f00 0x7efc40153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc3effd640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc400cc710 0x7efc40153ba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c4a0 tx=0x7efc3400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc27fff640 1 -- 172.21.15.26:0/371582374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34018070 con 0x7efc400cc710 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc27fff640 1 -- 172.21.15.26:0/371582374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc340074e0 con 0x7efc400cc710 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc400ce730 con 0x7efc400cc710 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc27fff640 1 -- 172.21.15.26:0/371582374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34004a20 con 0x7efc400cc710 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.651+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc400cecf0 con 0x7efc400cc710 2024-04-25T13:16:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.652+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc40068f50 con 0x7efc400cc710 2024-04-25T13:16:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.653+0000 7efc27fff640 1 -- 172.21.15.26:0/371582374 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc3401b070 con 0x7efc400cc710 2024-04-25T13:16:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.653+0000 7efc27fff640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7efc2c06c8f0 0x7efc2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.653+0000 7efc27fff640 1 -- 172.21.15.26:0/371582374 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efc3408b1a0 con 0x7efc400cc710 2024-04-25T13:16:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.653+0000 7efc3f7fe640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7efc2c06c8f0 0x7efc2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.654+0000 7efc3f7fe640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7efc2c06c8f0 0x7efc2c06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efc30034000 tx=0x7efc3002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.658+0000 7efc27fff640 1 -- 172.21.15.26:0/371582374 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc34059290 con 0x7efc400cc710 2024-04-25T13:16:27.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.840+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efc401588e0 con 0x7efc400cc710 2024-04-25T13:16:27.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.840+0000 7efc27fff640 1 -- 172.21.15.26:0/371582374 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7efc34058b90 con 0x7efc400cc710 2024-04-25T13:16:27.842 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-25T13:16:27.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7efc2c06c8f0 msgr2=0x7efc2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7efc2c06c8f0 0x7efc2c06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efc30034000 tx=0x7efc3002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:27.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc400cc710 msgr2=0x7efc40153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc400cc710 0x7efc40153ba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c4a0 tx=0x7efc3400c960 comp rx=0 tx=0).stop 2024-04-25T13:16:27.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 shutdown_connections 2024-04-25T13:16:27.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7efc2c06c8f0 0x7efc2c06edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc40154f00 0x7efc40153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc400cc710 0x7efc40153ba0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 --2- 172.21.15.26:0/371582374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc400b3600 0x7efc401499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 >> 172.21.15.26:0/371582374 conn(0x7efc40068570 msgr2=0x7efc401e43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 shutdown_connections 2024-04-25T13:16:27.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.842+0000 7efc45f43640 1 -- 172.21.15.26:0/371582374 wait complete. 2024-04-25T13:16:27.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.957+0000 7f5e40d19640 1 Processor -- start 2024-04-25T13:16:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.957+0000 7f5e40d19640 1 -- start start 2024-04-25T13:16:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e40d19640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e40d19640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5e3c0cbd40 0x7f5e3c0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e40d19640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3c0d1510 con 0x7f5e3c1554e0 2024-04-25T13:16:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e40d19640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3c0cced0 con 0x7f5e3c0cbd40 2024-04-25T13:16:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e40d19640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3c15bf00 con 0x7f5e3c0cc6f0 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e33fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e3ad9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5e3c0cbd40 0x7f5e3c0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e33fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:46686/0 (socket says 172.21.15.26:46686) 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e33fff640 1 -- 172.21.15.26:0/2634104054 learned_addr learned my addr 172.21.15.26:0/2634104054 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e33fff640 1 -- 172.21.15.26:0/2634104054 >> v2:172.21.15.169:3300/0 conn(0x7f5e3c0cbd40 msgr2=0x7f5e3c0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e33fff640 1 --2- 172.21.15.26:0/2634104054 >> v2:172.21.15.169:3300/0 conn(0x7f5e3c0cbd40 0x7f5e3c0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e33fff640 1 -- 172.21.15.26:0/2634104054 >> v1:172.21.15.169:6789/0 conn(0x7f5e3c1554e0 legacy=0x7f5e3c0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.958+0000 7f5e33fff640 1 -- 172.21.15.26:0/2634104054 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c15b5d0 con 0x7f5e3c0cc6f0 2024-04-25T13:16:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.959+0000 7f5e33fff640 1 --2- 172.21.15.26:0/2634104054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0cb800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009870 tx=0x7f5e2402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1087ca72c3d9b0da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.959+0000 7f5e39d9b640 1 -- 172.21.15.26:0/2634104054 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24037070 con 0x7f5e3c0cc6f0 2024-04-25T13:16:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.959+0000 7f5e39d9b640 1 -- 172.21.15.26:0/2634104054 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e24032440 con 0x7f5e3c0cc6f0 2024-04-25T13:16:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.959+0000 7f5e39d9b640 1 -- 172.21.15.26:0/2634104054 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24032810 con 0x7f5e3c0cc6f0 2024-04-25T13:16:27.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 -- 172.21.15.26:0/2634104054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 msgr2=0x7f5e3c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 --2- 172.21.15.26:0/2634104054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0cb800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009870 tx=0x7f5e2402a270 comp rx=0 tx=0).stop 2024-04-25T13:16:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 -- 172.21.15.26:0/2634104054 shutdown_connections 2024-04-25T13:16:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 --2- 172.21.15.26:0/2634104054 >> v2:172.21.15.169:3300/0 conn(0x7f5e3c0cbd40 0x7f5e3c0cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 --2- 172.21.15.26:0/2634104054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0cb800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 -- 172.21.15.26:0/2634104054 >> 172.21.15.26:0/2634104054 conn(0x7f5e3c074d50 msgr2=0x7f5e3c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 -- 172.21.15.26:0/2634104054 shutdown_connections 2024-04-25T13:16:27.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.960+0000 7f5e40d19640 1 -- 172.21.15.26:0/2634104054 wait complete. 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.961+0000 7f5e40d19640 1 Processor -- start 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.961+0000 7f5e40d19640 1 -- start start 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e40d19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e3c0cbd40 0x7f5e3c0c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e40d19640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e40d19640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e3c1554e0 0x7f5e3c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e40d19640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0d11e0 con 0x7f5e3c1554e0 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e40d19640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c15bb90 con 0x7f5e3c0cbd40 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e40d19640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3c15b280 con 0x7f5e3c0cc6f0 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e3ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e3c1554e0 0x7f5e3c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e3ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e3c1554e0 0x7f5e3c0ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41018/0 (socket says 172.21.15.26:41018) 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e3ad9d640 1 -- 172.21.15.26:0/801163079 learned_addr learned my addr 172.21.15.26:0/801163079 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e33fff640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e3a59c640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e3c0cbd40 0x7f5e3c0c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e3ad9d640 1 -- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 msgr2=0x7f5e3c0c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.962+0000 7f5e3ad9d640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e3ad9d640 1 -- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e3c0cbd40 msgr2=0x7f5e3c0c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e3ad9d640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e3c0cbd40 0x7f5e3c0c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e3ad9d640 1 -- 172.21.15.26:0/801163079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c158500 con 0x7f5e3c1554e0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e3ad9d640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e3c1554e0 0x7f5e3c0ca290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009dd0 tx=0x7f5e3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e32ffd640 1 -- 172.21.15.26:0/801163079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34018020 con 0x7f5e3c1554e0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e32ffd640 1 -- 172.21.15.26:0/801163079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e34014480 con 0x7f5e3c1554e0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e32ffd640 1 -- 172.21.15.26:0/801163079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34014870 con 0x7f5e3c1554e0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c0c8fd0 con 0x7f5e3c1554e0 2024-04-25T13:16:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.963+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c158a80 con 0x7f5e3c1554e0 2024-04-25T13:16:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.964+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3c15abb0 con 0x7f5e3c1554e0 2024-04-25T13:16:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.964+0000 7f5e32ffd640 1 -- 172.21.15.26:0/801163079 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e34005d10 con 0x7f5e3c1554e0 2024-04-25T13:16:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.965+0000 7f5e32ffd640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5e1c06c8f0 0x7f5e1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.965+0000 7f5e32ffd640 1 -- 172.21.15.26:0/801163079 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5e3408cb90 con 0x7f5e3c1554e0 2024-04-25T13:16:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.965+0000 7f5e3a59c640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5e1c06c8f0 0x7f5e1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.966+0000 7f5e3a59c640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5e1c06c8f0 0x7f5e1c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c80b0 tx=0x7f5e2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:27.969+0000 7f5e32ffd640 1 -- 172.21.15.26:0/801163079 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e3c15abb0 con 0x7f5e3c1554e0 2024-04-25T13:16:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.154+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5e3c068e40 con 0x7f5e3c1554e0 2024-04-25T13:16:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.155+0000 7f5e32ffd640 1 -- 172.21.15.26:0/801163079 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f5e34022030 con 0x7f5e3c1554e0 2024-04-25T13:16:28.156 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:16:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5e1c06c8f0 msgr2=0x7f5e1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5e1c06c8f0 0x7f5e1c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c80b0 tx=0x7f5e2c009040 comp rx=0 tx=0).stop 2024-04-25T13:16:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e3c1554e0 msgr2=0x7f5e3c0ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e3c1554e0 0x7f5e3c0ca290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009dd0 tx=0x7f5e3400c490 comp rx=0 tx=0).stop 2024-04-25T13:16:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 shutdown_connections 2024-04-25T13:16:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5e1c06c8f0 0x7f5e1c06edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e3c1554e0 0x7f5e3c0ca290 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e3c0cc6f0 0x7f5e3c0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 --2- 172.21.15.26:0/801163079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e3c0cbd40 0x7f5e3c0c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 >> 172.21.15.26:0/801163079 conn(0x7f5e3c074d50 msgr2=0x7f5e3c1590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 shutdown_connections 2024-04-25T13:16:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.157+0000 7f5e40d19640 1 -- 172.21.15.26:0/801163079 wait complete. 2024-04-25T13:16:28.169 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:16:28.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.270+0000 7f604a94f640 1 Processor -- start 2024-04-25T13:16:28.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.270+0000 7f604a94f640 1 -- start start 2024-04-25T13:16:28.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f604a94f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f604415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f604a94f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6044155550 0x7f60440d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f604a94f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60440cb9e0 0x7f60440d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f604a94f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f60440cddf0 con 0x7f60440cb9e0 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f604a94f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f604415f430 con 0x7f6044155550 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f604a94f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f60440ccf00 con 0x7f6044155170 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f6048eec640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60440cb9e0 0x7f60440d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f6048eec640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60440cb9e0 0x7f60440d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41034/0 (socket says 172.21.15.26:41034) 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f6048eec640 1 -- 172.21.15.26:0/2576026259 learned_addr learned my addr 172.21.15.26:0/2576026259 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f60437fe640 1 --2- 172.21.15.26:0/2576026259 >> v2:172.21.15.169:3300/0 conn(0x7f6044155550 0x7f60440d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.271+0000 7f6043fff640 1 --2- 172.21.15.26:0/2576026259 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f604415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6048eec640 1 -- 172.21.15.26:0/2576026259 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 msgr2=0x7f604415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6048eec640 1 --2- 172.21.15.26:0/2576026259 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f604415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6048eec640 1 -- 172.21.15.26:0/2576026259 >> v2:172.21.15.169:3300/0 conn(0x7f6044155550 msgr2=0x7f60440d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6048eec640 1 --2- 172.21.15.26:0/2576026259 >> v2:172.21.15.169:3300/0 conn(0x7f6044155550 0x7f60440d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6048eec640 1 -- 172.21.15.26:0/2576026259 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60440cd1e0 con 0x7f60440cb9e0 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6048eec640 1 --2- 172.21.15.26:0/2576026259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60440cb9e0 0x7f60440d0da0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60440ce430 tx=0x7f603c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f5057b42a2d903 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6042ffd640 1 -- 172.21.15.26:0/2576026259 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c036070 con 0x7f60440cb9e0 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6042ffd640 1 -- 172.21.15.26:0/2576026259 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603c031600 con 0x7f60440cb9e0 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.272+0000 7f6042ffd640 1 -- 172.21.15.26:0/2576026259 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c0319d0 con 0x7f60440cb9e0 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 -- 172.21.15.26:0/2576026259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60440cb9e0 msgr2=0x7f60440d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 --2- 172.21.15.26:0/2576026259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60440cb9e0 0x7f60440d0da0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60440ce430 tx=0x7f603c02a610 comp rx=0 tx=0).stop 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 -- 172.21.15.26:0/2576026259 shutdown_connections 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 --2- 172.21.15.26:0/2576026259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60440cb9e0 0x7f60440d0da0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 --2- 172.21.15.26:0/2576026259 >> v2:172.21.15.169:3300/0 conn(0x7f6044155550 0x7f60440d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 --2- 172.21.15.26:0/2576026259 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f604415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 -- 172.21.15.26:0/2576026259 >> 172.21.15.26:0/2576026259 conn(0x7f6044072570 msgr2=0x7f6044074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 -- 172.21.15.26:0/2576026259 shutdown_connections 2024-04-25T13:16:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.273+0000 7f604a94f640 1 -- 172.21.15.26:0/2576026259 wait complete. 2024-04-25T13:16:28.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.274+0000 7f604a94f640 1 Processor -- start 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.274+0000 7f604a94f640 1 -- start start 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f604a94f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60440cb9e0 0x7f604415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f604a94f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f6044156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f604a94f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044155550 0x7f6044159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f604a94f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f60440cda80 con 0x7f6044155550 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f604a94f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60440cd7a0 con 0x7f60440cb9e0 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f604a94f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f60440ccae0 con 0x7f6044155170 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f6048eec640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044155550 0x7f6044159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f6048eec640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044155550 0x7f6044159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41050/0 (socket says 172.21.15.26:41050) 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f6048eec640 1 -- 172.21.15.26:0/1329301416 learned_addr learned my addr 172.21.15.26:0/1329301416 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f6043fff640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60440cb9e0 0x7f604415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.275+0000 7f60437fe640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f6044156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.276+0000 7f6048eec640 1 -- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 msgr2=0x7f6044156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.276+0000 7f6048eec640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f6044156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.276+0000 7f6048eec640 1 -- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60440cb9e0 msgr2=0x7f604415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.276+0000 7f6048eec640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60440cb9e0 0x7f604415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.276+0000 7f6048eec640 1 -- 172.21.15.26:0/1329301416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6044157490 con 0x7f6044155550 2024-04-25T13:16:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.276+0000 7f6048eec640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044155550 0x7f6044159250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f603c009f40 tx=0x7f603c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.277+0000 7f6040ff9640 1 -- 172.21.15.26:0/1329301416 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c036050 con 0x7f6044155550 2024-04-25T13:16:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.277+0000 7f6040ff9640 1 -- 172.21.15.26:0/1329301416 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603c042070 con 0x7f6044155550 2024-04-25T13:16:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.277+0000 7f6040ff9640 1 -- 172.21.15.26:0/1329301416 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c009510 con 0x7f6044155550 2024-04-25T13:16:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.277+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6044157770 con 0x7f6044155550 2024-04-25T13:16:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.277+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6044157d30 con 0x7f6044155550 2024-04-25T13:16:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.278+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6044068e40 con 0x7f6044155550 2024-04-25T13:16:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.279+0000 7f6040ff9640 1 -- 172.21.15.26:0/1329301416 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f603c007bd0 con 0x7f6044155550 2024-04-25T13:16:28.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.279+0000 7f6040ff9640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f602406c940 0x7f602406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.279+0000 7f6040ff9640 1 -- 172.21.15.26:0/1329301416 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f603c0acab0 con 0x7f6044155550 2024-04-25T13:16:28.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.279+0000 7f6043fff640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f602406c940 0x7f602406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.280+0000 7f6043fff640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f602406c940 0x7f602406ee00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6034006fd0 tx=0x7f6034008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.284+0000 7f6040ff9640 1 -- 172.21.15.26:0/1329301416 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f603c07a630 con 0x7f6044155550 2024-04-25T13:16:28.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.481+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60440cc2b0 con 0x7f6044155550 2024-04-25T13:16:28.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.481+0000 7f6040ff9640 1 -- 172.21.15.26:0/1329301416 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f603c07e930 con 0x7f6044155550 2024-04-25T13:16:28.482 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-25T13:16:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f602406c940 msgr2=0x7f602406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f602406c940 0x7f602406ee00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6034006fd0 tx=0x7f6034008040 comp rx=0 tx=0).stop 2024-04-25T13:16:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044155550 msgr2=0x7f6044159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044155550 0x7f6044159250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f603c009f40 tx=0x7f603c004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 shutdown_connections 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f602406c940 0x7f602406ee00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044155550 0x7f6044159250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155170 0x7f6044156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 --2- 172.21.15.26:0/1329301416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60440cb9e0 0x7f604415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 >> 172.21.15.26:0/1329301416 conn(0x7f6044072570 msgr2=0x7f6044150360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 shutdown_connections 2024-04-25T13:16:28.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.483+0000 7f604a94f640 1 -- 172.21.15.26:0/1329301416 wait complete. 2024-04-25T13:16:28.495 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:16:28.495 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:16:28.511 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:28.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.651+0000 7f28df708640 1 Processor -- start 2024-04-25T13:16:28.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.651+0000 7f28df708640 1 -- start start 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28df708640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28df708640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28d80c99f0 0x7f28d80c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28df708640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d815bef0 con 0x7f28d806bb90 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28df708640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f28d815f510 con 0x7f28d80c99f0 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28df708640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f28d815b650 con 0x7f28d806bf70 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28ddca5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28d80c99f0 0x7f28d80c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28ddca5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28d80c99f0 0x7f28d80c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41064/0 (socket says 172.21.15.26:41064) 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28ddca5640 1 -- 172.21.15.26:0/3134151053 learned_addr learned my addr 172.21.15.26:0/3134151053 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28dcca3640 1 --2- 172.21.15.26:0/3134151053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28ddca5640 1 -- 172.21.15.26:0/3134151053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 msgr2=0x7f28d815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28ddca5640 1 --2- 172.21.15.26:0/3134151053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28ddca5640 1 -- 172.21.15.26:0/3134151053 >> v1:172.21.15.169:6789/0 conn(0x7f28d806bb90 legacy=0x7f28d815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.652+0000 7f28ddca5640 1 -- 172.21.15.26:0/3134151053 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d815b930 con 0x7f28d80c99f0 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.653+0000 7f28ddca5640 1 --2- 172.21.15.26:0/3134151053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d80c99f0 0x7f28d80c9e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009e50 tx=0x7f28d002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f516a84572d66f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.653+0000 7f28cffff640 1 -- 172.21.15.26:0/3134151053 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0036070 con 0x7f28d80c99f0 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.653+0000 7f28cffff640 1 -- 172.21.15.26:0/3134151053 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d0031600 con 0x7f28d80c99f0 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.653+0000 7f28cffff640 1 -- 172.21.15.26:0/3134151053 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d00319d0 con 0x7f28d80c99f0 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 -- 172.21.15.26:0/3134151053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d80c99f0 msgr2=0x7f28d80c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 --2- 172.21.15.26:0/3134151053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d80c99f0 0x7f28d80c9e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009e50 tx=0x7f28d002a750 comp rx=0 tx=0).stop 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 -- 172.21.15.26:0/3134151053 shutdown_connections 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 --2- 172.21.15.26:0/3134151053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d80c99f0 0x7f28d80c9e80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 --2- 172.21.15.26:0/3134151053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 -- 172.21.15.26:0/3134151053 >> 172.21.15.26:0/3134151053 conn(0x7f28d8074d50 msgr2=0x7f28d8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 -- 172.21.15.26:0/3134151053 shutdown_connections 2024-04-25T13:16:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.654+0000 7f28df708640 1 -- 172.21.15.26:0/3134151053 wait complete. 2024-04-25T13:16:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 Processor -- start 2024-04-25T13:16:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 -- start start 2024-04-25T13:16:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d806bb90 0x7f28d80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d814c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d80c99f0 0x7f28d814c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f28d815e8e0 con 0x7f28d806bb90 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f28d815e600 con 0x7f28d80c99f0 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.655+0000 7f28df708640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f28d8074560 con 0x7f28d806bf70 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d806bb90 0x7f28d80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d806bb90 0x7f28d80ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41072/0 (socket says 172.21.15.26:41072) 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 -- 172.21.15.26:0/4076587796 learned_addr learned my addr 172.21.15.26:0/4076587796 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dcca3640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d814c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28ddca5640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d80c99f0 0x7f28d814c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 -- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 msgr2=0x7f28d814c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d814c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 -- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d80c99f0 msgr2=0x7f28d814c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d80c99f0 0x7f28d814c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 -- 172.21.15.26:0/4076587796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d81f0e80 con 0x7f28d806bb90 2024-04-25T13:16:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dcca3640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28dd4a4640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d806bb90 0x7f28d80ce910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c460 tx=0x7f28d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28cdffb640 1 -- 172.21.15.26:0/4076587796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4016020 con 0x7f28d806bb90 2024-04-25T13:16:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28cdffb640 1 -- 172.21.15.26:0/4076587796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4012870 con 0x7f28d806bb90 2024-04-25T13:16:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28cdffb640 1 -- 172.21.15.26:0/4076587796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4012c60 con 0x7f28d806bb90 2024-04-25T13:16:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.656+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d81f1160 con 0x7f28d806bb90 2024-04-25T13:16:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.657+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d81f1720 con 0x7f28d806bb90 2024-04-25T13:16:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.658+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d8068e40 con 0x7f28d806bb90 2024-04-25T13:16:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.658+0000 7f28cdffb640 1 -- 172.21.15.26:0/4076587796 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28d4019020 con 0x7f28d806bb90 2024-04-25T13:16:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.658+0000 7f28cdffb640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f28bc06c8f0 0x7f28bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.658+0000 7f28cdffb640 1 -- 172.21.15.26:0/4076587796 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f28d408be40 con 0x7f28d806bb90 2024-04-25T13:16:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.659+0000 7f28dcca3640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f28bc06c8f0 0x7f28bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.659+0000 7f28dcca3640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f28bc06c8f0 0x7f28bc06edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28d81e7060 tx=0x7f28c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.663+0000 7f28cdffb640 1 -- 172.21.15.26:0/4076587796 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28d4020020 con 0x7f28d806bb90 2024-04-25T13:16:28.744 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-25T13:16:28.744+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:16:28.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.848+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28d814f8f0 con 0x7f28d806bb90 2024-04-25T13:16:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.849+0000 7f28cdffb640 1 -- 172.21.15.26:0/4076587796 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f28d40182c0 con 0x7f28d806bb90 2024-04-25T13:16:28.850 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:28.850 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f28bc06c8f0 msgr2=0x7f28bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f28bc06c8f0 0x7f28bc06edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28d81e7060 tx=0x7f28c8008040 comp rx=0 tx=0).stop 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d806bb90 msgr2=0x7f28d80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d806bb90 0x7f28d80ce910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c460 tx=0x7f28d400c920 comp rx=0 tx=0).stop 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 shutdown_connections 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f28bc06c8f0 0x7f28bc06edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d80c99f0 0x7f28d814c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d806bf70 0x7f28d814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 --2- 172.21.15.26:0/4076587796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28d806bb90 0x7f28d80ce910 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 >> 172.21.15.26:0/4076587796 conn(0x7f28d8074d50 msgr2=0x7f28d8154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 shutdown_connections 2024-04-25T13:16:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.852+0000 7f28df708640 1 -- 172.21.15.26:0/4076587796 wait complete. 2024-04-25T13:16:28.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:07.306201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:08.537870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:12.230813+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:28.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.966+0000 7f02ff664640 1 Processor -- start 2024-04-25T13:16:28.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.966+0000 7f02ff664640 1 -- start start 2024-04-25T13:16:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02ff664640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02f8144150 0x7f02f80c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02ff664640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f8072380 con 0x7f02f815baf0 2024-04-25T13:16:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02ff664640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f8072660 con 0x7f02f815c660 2024-04-25T13:16:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02ff664640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f02f8072940 con 0x7f02f8144150 2024-04-25T13:16:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02fd400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02f8144150 0x7f02f80c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02fcbff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f02f815baf0 0x7f02f8074d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36926/0 (socket says 172.21.15.26:36926) 2024-04-25T13:16:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02fd400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02f8144150 0x7f02f80c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41088/0 (socket says 172.21.15.26:41088) 2024-04-25T13:16:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.967+0000 7f02fcbff640 1 -- 172.21.15.26:0/967015690 learned_addr learned my addr 172.21.15.26:0/967015690 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.968+0000 7f02fd400640 1 -- 172.21.15.26:0/967015690 >> v1:172.21.15.169:6789/0 conn(0x7f02f815c660 legacy=0x7f02f815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.968+0000 7f02fd400640 1 -- 172.21.15.26:0/967015690 >> v1:172.21.15.26:6789/0 conn(0x7f02f815baf0 legacy=0x7f02f8074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.968+0000 7f02fd400640 1 -- 172.21.15.26:0/967015690 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f8072c20 con 0x7f02f8144150 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.968+0000 7f02fd400640 1 --2- 172.21.15.26:0/967015690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f8144150 0x7f02f80c7ea0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009d90 tx=0x7f02f002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82add622bb03013 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.968+0000 7f02effff640 1 -- 172.21.15.26:0/967015690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0007740 con 0x7f02f8144150 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.968+0000 7f02effff640 1 -- 172.21.15.26:0/967015690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f00078e0 con 0x7f02f8144150 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.968+0000 7f02effff640 1 -- 172.21.15.26:0/967015690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0007cb0 con 0x7f02f8144150 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.969+0000 7f02ff664640 1 -- 172.21.15.26:0/967015690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f8144150 msgr2=0x7f02f80c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.969+0000 7f02ff664640 1 --2- 172.21.15.26:0/967015690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f8144150 0x7f02f80c7ea0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009d90 tx=0x7f02f002a730 comp rx=0 tx=0).stop 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.969+0000 7f02ff664640 1 -- 172.21.15.26:0/967015690 shutdown_connections 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.969+0000 7f02ff664640 1 --2- 172.21.15.26:0/967015690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f8144150 0x7f02f80c7ea0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.969+0000 7f02ff664640 1 -- 172.21.15.26:0/967015690 >> 172.21.15.26:0/967015690 conn(0x7f02f806b920 msgr2=0x7f02f806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.969+0000 7f02ff664640 1 -- 172.21.15.26:0/967015690 shutdown_connections 2024-04-25T13:16:28.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.969+0000 7f02ff664640 1 -- 172.21.15.26:0/967015690 wait complete. 2024-04-25T13:16:28.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.970+0000 7f02ff664640 1 Processor -- start 2024-04-25T13:16:28.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.970+0000 7f02ff664640 1 -- start start 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02ff664640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8144150 0x7f02f81f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02ff664640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f815baf0 0x7f02f81f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02ff664640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02f815c660 0x7f02f80cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02ff664640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8144530 con 0x7f02f815baf0 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02ff664640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02f815bf40 con 0x7f02f8144150 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02ff664640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f02f80705c0 con 0x7f02f815c660 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02fcbff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f815baf0 0x7f02f81f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02fcbff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f815baf0 0x7f02f81f21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41098/0 (socket says 172.21.15.26:41098) 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02fcbff640 1 -- 172.21.15.26:0/3074397425 learned_addr learned my addr 172.21.15.26:0/3074397425 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02fdc01640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02f815c660 0x7f02f80cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.971+0000 7f02fd400640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8144150 0x7f02f81f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02fcbff640 1 -- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02f815c660 msgr2=0x7f02f80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02fcbff640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02f815c660 0x7f02f80cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02fcbff640 1 -- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8144150 msgr2=0x7f02f81f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02fcbff640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8144150 0x7f02f81f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02fcbff640 1 -- 172.21.15.26:0/3074397425 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f80c78f0 con 0x7f02f815baf0 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02fcbff640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f815baf0 0x7f02f81f21a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c400 tx=0x7f02f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02edffb640 1 -- 172.21.15.26:0/3074397425 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4017070 con 0x7f02f815baf0 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02edffb640 1 -- 172.21.15.26:0/3074397425 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f4005ce0 con 0x7f02f815baf0 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02edffb640 1 -- 172.21.15.26:0/3074397425 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40072f0 con 0x7f02f815baf0 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f81f26e0 con 0x7f02f815baf0 2024-04-25T13:16:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.972+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f8141450 con 0x7f02f815baf0 2024-04-25T13:16:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.973+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f8075b40 con 0x7f02f815baf0 2024-04-25T13:16:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.973+0000 7f02edffb640 1 -- 172.21.15.26:0/3074397425 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02f401a070 con 0x7f02f815baf0 2024-04-25T13:16:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.974+0000 7f02edffb640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f02e406c8f0 0x7f02e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.974+0000 7f02edffb640 1 -- 172.21.15.26:0/3074397425 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f02f408b220 con 0x7f02f815baf0 2024-04-25T13:16:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.974+0000 7f02fd400640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f02e406c8f0 0x7f02e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.975+0000 7f02fd400640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f02e406c8f0 0x7f02e406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02f0034000 tx=0x7f02f002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:28.978+0000 7f02edffb640 1 -- 172.21.15.26:0/3074397425 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02f8075b40 con 0x7f02f815baf0 2024-04-25T13:16:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.162+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02f8068f50 con 0x7f02f815baf0 2024-04-25T13:16:29.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.163+0000 7f02edffb640 1 -- 172.21.15.26:0/3074397425 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f02f4058c30 con 0x7f02f815baf0 2024-04-25T13:16:29.173 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:16:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f02e406c8f0 msgr2=0x7f02e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f02e406c8f0 0x7f02e406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02f0034000 tx=0x7f02f002f000 comp rx=0 tx=0).stop 2024-04-25T13:16:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f815baf0 msgr2=0x7f02f81f21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f815baf0 0x7f02f81f21a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c400 tx=0x7f02f400c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 shutdown_connections 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f02e406c8f0 0x7f02e406edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02f815c660 0x7f02f80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f815baf0 0x7f02f81f21a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 --2- 172.21.15.26:0/3074397425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8144150 0x7f02f81f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 >> 172.21.15.26:0/3074397425 conn(0x7f02f806b920 msgr2=0x7f02f815da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 shutdown_connections 2024-04-25T13:16:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.165+0000 7f02ff664640 1 -- 172.21.15.26:0/3074397425 wait complete. 2024-04-25T13:16:29.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:29.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.281+0000 7f0575672640 1 Processor -- start 2024-04-25T13:16:29.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.281+0000 7f0575672640 1 -- start start 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.281+0000 7f0575672640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05700c9800 0x7f057015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.281+0000 7f0575672640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0570074310 0x7f057015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.281+0000 7f0575672640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057015b3c0 con 0x7f05701552e0 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.281+0000 7f0575672640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f057015c610 con 0x7f0570074310 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.281+0000 7f0575672640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f057015b6a0 con 0x7f05700c9800 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0570074310 0x7f057015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f05701552e0 0x7f05700ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36940/0 (socket says 172.21.15.26:36940) 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0570074310 0x7f057015cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41110/0 (socket says 172.21.15.26:41110) 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056effd640 1 -- 172.21.15.26:0/4215671645 learned_addr learned my addr 172.21.15.26:0/4215671645 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f0567fff640 1 --2- 172.21.15.26:0/4215671645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05700c9800 0x7f057015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056f7fe640 1 -- 172.21.15.26:0/4215671645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05700c9800 msgr2=0x7f057015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056f7fe640 1 --2- 172.21.15.26:0/4215671645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05700c9800 0x7f057015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056f7fe640 1 -- 172.21.15.26:0/4215671645 >> v1:172.21.15.26:6789/0 conn(0x7f05701552e0 legacy=0x7f05700ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.282+0000 7f056f7fe640 1 -- 172.21.15.26:0/4215671645 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057015b980 con 0x7f0570074310 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.283+0000 7f056f7fe640 1 --2- 172.21.15.26:0/4215671645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0570074310 0x7f057015cfe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0568009d90 tx=0x7f056802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ff087b9d11677a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.283+0000 7f056e7fc640 1 -- 172.21.15.26:0/4215671645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568007740 con 0x7f0570074310 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.283+0000 7f056e7fc640 1 -- 172.21.15.26:0/4215671645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05680078e0 con 0x7f0570074310 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.283+0000 7f056e7fc640 1 -- 172.21.15.26:0/4215671645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568007cb0 con 0x7f0570074310 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.283+0000 7f0575672640 1 -- 172.21.15.26:0/4215671645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0570074310 msgr2=0x7f057015cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.283+0000 7f0575672640 1 --2- 172.21.15.26:0/4215671645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0570074310 0x7f057015cfe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0568009d90 tx=0x7f056802a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.284+0000 7f0575672640 1 -- 172.21.15.26:0/4215671645 shutdown_connections 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.284+0000 7f0575672640 1 --2- 172.21.15.26:0/4215671645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0570074310 0x7f057015cfe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.284+0000 7f0575672640 1 --2- 172.21.15.26:0/4215671645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05700c9800 0x7f057015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.284+0000 7f0575672640 1 -- 172.21.15.26:0/4215671645 >> 172.21.15.26:0/4215671645 conn(0x7f0570074d50 msgr2=0x7f0570075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.284+0000 7f0575672640 1 -- 172.21.15.26:0/4215671645 shutdown_connections 2024-04-25T13:16:29.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.284+0000 7f0575672640 1 -- 172.21.15.26:0/4215671645 wait complete. 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 Processor -- start 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 -- start start 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0570074310 0x7f05700ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05700c9800 0x7f057015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05701552e0 0x7f05701f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f057015b090 con 0x7f05701552e0 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f057015bf40 con 0x7f05700c9800 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.285+0000 7f0575672640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f05701556c0 con 0x7f0570074310 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05701552e0 0x7f05701f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05701552e0 0x7f05701f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41116/0 (socket says 172.21.15.26:41116) 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 -- 172.21.15.26:0/2694256403 learned_addr learned my addr 172.21.15.26:0/2694256403 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:29.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056effd640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0570074310 0x7f05700ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f0567fff640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05700c9800 0x7f057015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 -- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0570074310 msgr2=0x7f05700ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0570074310 0x7f05700ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 -- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05700c9800 msgr2=0x7f057015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05700c9800 0x7f057015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 -- 172.21.15.26:0/2694256403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05700cab50 con 0x7f05701552e0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f056f7fe640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05701552e0 0x7f05701f4840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0568009eb0 tx=0x7f0568004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f05677fe640 1 -- 172.21.15.26:0/2694256403 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568040070 con 0x7f05701552e0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f05677fe640 1 -- 172.21.15.26:0/2694256403 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0568031bc0 con 0x7f05701552e0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05701f10a0 con 0x7f05701552e0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f05677fe640 1 -- 172.21.15.26:0/2694256403 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568009450 con 0x7f05701552e0 2024-04-25T13:16:29.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.286+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05701f1620 con 0x7f05701552e0 2024-04-25T13:16:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.287+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0570068e40 con 0x7f05701552e0 2024-04-25T13:16:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.288+0000 7f05677fe640 1 -- 172.21.15.26:0/2694256403 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0568039040 con 0x7f05701552e0 2024-04-25T13:16:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.288+0000 7f05677fe640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f055006c8f0 0x7f055006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.288+0000 7f05677fe640 1 -- 172.21.15.26:0/2694256403 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f05680ad520 con 0x7f05701552e0 2024-04-25T13:16:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.289+0000 7f056effd640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f055006c8f0 0x7f055006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.289+0000 7f056effd640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f055006c8f0 0x7f055006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0560007fd0 tx=0x7f0560007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.293+0000 7f05677fe640 1 -- 172.21.15.26:0/2694256403 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05700cab50 con 0x7f05701552e0 2024-04-25T13:16:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.476+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0570153860 con 0x7f05701552e0 2024-04-25T13:16:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.477+0000 7f05677fe640 1 -- 172.21.15.26:0/2694256403 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f056807afc0 con 0x7f05701552e0 2024-04-25T13:16:29.478 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:16:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f055006c8f0 msgr2=0x7f055006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f055006c8f0 0x7f055006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0560007fd0 tx=0x7f0560007e80 comp rx=0 tx=0).stop 2024-04-25T13:16:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05701552e0 msgr2=0x7f05701f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05701552e0 0x7f05701f4840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0568009eb0 tx=0x7f0568004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 shutdown_connections 2024-04-25T13:16:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f055006c8f0 0x7f055006edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05701552e0 0x7f05701f4840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05700c9800 0x7f057015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 --2- 172.21.15.26:0/2694256403 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0570074310 0x7f05700ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 >> 172.21.15.26:0/2694256403 conn(0x7f0570074d50 msgr2=0x7f0570153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 shutdown_connections 2024-04-25T13:16:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.479+0000 7f0575672640 1 -- 172.21.15.26:0/2694256403 wait complete. 2024-04-25T13:16:29.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:29.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.634+0000 7ffaadf95640 1 Processor -- start 2024-04-25T13:16:29.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.634+0000 7ffaadf95640 1 -- start start 2024-04-25T13:16:29.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaadf95640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffaa806ec80 0x7ffaa80737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaadf95640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffaa80c8640 0x7ffaa8073d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaadf95640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa8159ad0 con 0x7ffaa8152fc0 2024-04-25T13:16:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaadf95640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa8071b80 con 0x7ffaa806ec80 2024-04-25T13:16:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaadf95640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa8071e60 con 0x7ffaa80c8640 2024-04-25T13:16:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaa6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffaa806ec80 0x7ffaa80737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaa6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffaa806ec80 0x7ffaa80737c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41130/0 (socket says 172.21.15.26:41130) 2024-04-25T13:16:29.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.635+0000 7ffaa6ffd640 1 -- 172.21.15.26:0/3322931503 learned_addr learned my addr 172.21.15.26:0/3322931503 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.636+0000 7ffaa7fff640 1 --2- 172.21.15.26:0/3322931503 >> v2:172.21.15.169:3300/0 conn(0x7ffaa80c8640 0x7ffaa8073d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.636+0000 7ffaa6ffd640 1 -- 172.21.15.26:0/3322931503 >> v2:172.21.15.169:3300/0 conn(0x7ffaa80c8640 msgr2=0x7ffaa8073d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.636+0000 7ffaa6ffd640 1 --2- 172.21.15.26:0/3322931503 >> v2:172.21.15.169:3300/0 conn(0x7ffaa80c8640 0x7ffaa8073d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.636+0000 7ffaa6ffd640 1 -- 172.21.15.26:0/3322931503 >> v1:172.21.15.169:6789/0 conn(0x7ffaa8152fc0 legacy=0x7ffaa806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.636+0000 7ffaa6ffd640 1 -- 172.21.15.26:0/3322931503 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa81533a0 con 0x7ffaa806ec80 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.636+0000 7ffaa6ffd640 1 --2- 172.21.15.26:0/3322931503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80737c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa81535d0 tx=0x7ffa9c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9141905f09d6b900 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaa67fc640 1 -- 172.21.15.26:0/3322931503 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c037070 con 0x7ffaa806ec80 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaa67fc640 1 -- 172.21.15.26:0/3322931503 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c02ae50 con 0x7ffaa806ec80 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaa67fc640 1 -- 172.21.15.26:0/3322931503 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c032860 con 0x7ffaa806ec80 2024-04-25T13:16:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 -- 172.21.15.26:0/3322931503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 msgr2=0x7ffaa80737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 --2- 172.21.15.26:0/3322931503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80737c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa81535d0 tx=0x7ffa9c02a300 comp rx=0 tx=0).stop 2024-04-25T13:16:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 -- 172.21.15.26:0/3322931503 shutdown_connections 2024-04-25T13:16:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 --2- 172.21.15.26:0/3322931503 >> v2:172.21.15.169:3300/0 conn(0x7ffaa80c8640 0x7ffaa8073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 --2- 172.21.15.26:0/3322931503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80737c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 -- 172.21.15.26:0/3322931503 >> 172.21.15.26:0/3322931503 conn(0x7ffaa806f4f0 msgr2=0x7ffaa806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 -- 172.21.15.26:0/3322931503 shutdown_connections 2024-04-25T13:16:29.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.637+0000 7ffaadf95640 1 -- 172.21.15.26:0/3322931503 wait complete. 2024-04-25T13:16:29.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.638+0000 7ffaadf95640 1 Processor -- start 2024-04-25T13:16:29.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaadf95640 1 -- start start 2024-04-25T13:16:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaadf95640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaadf95640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffaa80c8640 0x7ffaa8149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaadf95640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8152fc0 0x7ffaa814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaadf95640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80722c0 con 0x7ffaa806ec80 2024-04-25T13:16:29.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaadf95640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8072140 con 0x7ffaa8152fc0 2024-04-25T13:16:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaadf95640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa806dce0 con 0x7ffaa80c8640 2024-04-25T13:16:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaa77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaa77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41142/0 (socket says 172.21.15.26:41142) 2024-04-25T13:16:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.639+0000 7ffaa77fe640 1 -- 172.21.15.26:0/1909278660 learned_addr learned my addr 172.21.15.26:0/1909278660 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa6ffd640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffaa80c8640 0x7ffaa8149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa7fff640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8152fc0 0x7ffaa814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa77fe640 1 -- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffaa80c8640 msgr2=0x7ffaa8149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa77fe640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffaa80c8640 0x7ffaa8149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa77fe640 1 -- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8152fc0 msgr2=0x7ffaa814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa77fe640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8152fc0 0x7ffaa814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa77fe640 1 -- 172.21.15.26:0/1909278660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa814ac40 con 0x7ffaa806ec80 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa6ffd640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffaa80c8640 0x7ffaa8149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa7fff640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8152fc0 0x7ffaa814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaa77fe640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80c9ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c3f0 tx=0x7ffa9800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffa8ffff640 1 -- 172.21.15.26:0/1909278660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980052d0 con 0x7ffaa806ec80 2024-04-25T13:16:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffa8ffff640 1 -- 172.21.15.26:0/1909278660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa98005490 con 0x7ffaa806ec80 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa81f5010 con 0x7ffaa806ec80 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffa8ffff640 1 -- 172.21.15.26:0/1909278660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98007260 con 0x7ffaa806ec80 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.640+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa814b190 con 0x7ffaa806ec80 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.641+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa8068f50 con 0x7ffaa806ec80 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.642+0000 7ffa8ffff640 1 -- 172.21.15.26:0/1909278660 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa98007400 con 0x7ffaa806ec80 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.642+0000 7ffa8ffff640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffa9406c920 0x7ffa9406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.642+0000 7ffa8ffff640 1 -- 172.21.15.26:0/1909278660 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffa9808b330 con 0x7ffaa806ec80 2024-04-25T13:16:29.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.642+0000 7ffaa6ffd640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffa9406c920 0x7ffa9406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.643+0000 7ffaa6ffd640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffa9406c920 0x7ffa9406ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c034000 tx=0x7ffa9c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.646+0000 7ffa8ffff640 1 -- 172.21.15.26:0/1909278660 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa98059420 con 0x7ffaa806ec80 2024-04-25T13:16:29.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.831+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffaa806e9f0 con 0x7ffaa806ec80 2024-04-25T13:16:29.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.831+0000 7ffa8ffff640 1 -- 172.21.15.26:0/1909278660 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7ffa98058d20 con 0x7ffaa806ec80 2024-04-25T13:16:29.832 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-25T13:16:29.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffa9406c920 msgr2=0x7ffa9406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffa9406c920 0x7ffa9406ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c034000 tx=0x7ffa9c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:29.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 msgr2=0x7ffaa80c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80c9ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c3f0 tx=0x7ffa9800c8b0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 shutdown_connections 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffa9406c920 0x7ffa9406ede0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8152fc0 0x7ffaa814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffaa80c8640 0x7ffaa8149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 --2- 172.21.15.26:0/1909278660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa806ec80 0x7ffaa80c9ac0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 >> 172.21.15.26:0/1909278660 conn(0x7ffaa806f4f0 msgr2=0x7ffaa8072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 shutdown_connections 2024-04-25T13:16:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.833+0000 7ffaadf95640 1 -- 172.21.15.26:0/1909278660 wait complete. 2024-04-25T13:16:29.845 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.948+0000 7f7ac6664640 1 Processor -- start 2024-04-25T13:16:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.949+0000 7f7ac6664640 1 -- start start 2024-04-25T13:16:29.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.949+0000 7f7ac6664640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7ac0151ed0 0x7f7ac00c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.949+0000 7f7ac6664640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac0157f70 con 0x7f7ac015be40 2024-04-25T13:16:29.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.949+0000 7f7ac6664640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac0158210 con 0x7f7ac00c8df0 2024-04-25T13:16:29.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.949+0000 7f7ac6664640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac01584f0 con 0x7f7ac0151ed0 2024-04-25T13:16:29.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7ac4c01640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7ac015be40 0x7f7ac00c9d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36942/0 (socket says 172.21.15.26:36942) 2024-04-25T13:16:29.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7ac4c01640 1 -- 172.21.15.26:0/1908358105 learned_addr learned my addr 172.21.15.26:0/1908358105 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:29.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7abffff640 1 --2- 172.21.15.26:0/1908358105 >> v2:172.21.15.169:3300/0 conn(0x7f7ac0151ed0 0x7f7ac00c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7abeffd640 1 -- 172.21.15.26:0/1908358105 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155812502 0 0) 0x7f7ac0157f70 con 0x7f7ac015be40 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7abeffd640 1 -- 172.21.15.26:0/1908358105 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa8003520 con 0x7f7ac015be40 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7abffff640 1 -- 172.21.15.26:0/1908358105 >> v1:172.21.15.169:6789/0 conn(0x7f7ac00c8df0 legacy=0x7f7ac015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7abffff640 1 -- 172.21.15.26:0/1908358105 >> v1:172.21.15.26:6789/0 conn(0x7f7ac015be40 legacy=0x7f7ac00c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7abeffd640 1 -- 172.21.15.26:0/1908358105 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1343003830 0 0) 0x7f7aa8003520 con 0x7f7ac015be40 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.950+0000 7f7abffff640 1 -- 172.21.15.26:0/1908358105 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac01587d0 con 0x7f7ac0151ed0 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.951+0000 7f7abffff640 1 --2- 172.21.15.26:0/1908358105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 0x7f7ac00c88b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00097a0 tx=0x7f7ab002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e6c877e14b6affe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.951+0000 7f7abeffd640 1 -- 172.21.15.26:0/1908358105 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0037070 con 0x7f7ac0151ed0 2024-04-25T13:16:29.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.951+0000 7f7abeffd640 1 -- 172.21.15.26:0/1908358105 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab002ac50 con 0x7f7ac0151ed0 2024-04-25T13:16:29.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.951+0000 7f7abeffd640 1 -- 172.21.15.26:0/1908358105 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80019f0 con 0x7f7ac0151ed0 2024-04-25T13:16:29.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.952+0000 7f7ac6664640 1 -- 172.21.15.26:0/1908358105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 msgr2=0x7f7ac00c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.952+0000 7f7ac6664640 1 --2- 172.21.15.26:0/1908358105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 0x7f7ac00c88b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00097a0 tx=0x7f7ab002a1c0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.952+0000 7f7ac6664640 1 -- 172.21.15.26:0/1908358105 shutdown_connections 2024-04-25T13:16:29.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.952+0000 7f7ac6664640 1 --2- 172.21.15.26:0/1908358105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 0x7f7ac00c88b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.952+0000 7f7ac6664640 1 -- 172.21.15.26:0/1908358105 >> 172.21.15.26:0/1908358105 conn(0x7f7ac006b920 msgr2=0x7f7ac006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.952+0000 7f7ac6664640 1 -- 172.21.15.26:0/1908358105 shutdown_connections 2024-04-25T13:16:29.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.952+0000 7f7ac6664640 1 -- 172.21.15.26:0/1908358105 wait complete. 2024-04-25T13:16:29.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.953+0000 7f7ac6664640 1 Processor -- start 2024-04-25T13:16:29.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.953+0000 7f7ac6664640 1 -- start start 2024-04-25T13:16:29.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7ac6664640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ac00c8df0 0x7f7ac0150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7ac6664640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 0x7f7ac013d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7ac6664640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac015be40 0x7f7ac0137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7ac6664640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00ce2d0 con 0x7f7ac00c8df0 2024-04-25T13:16:29.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7ac6664640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01522b0 con 0x7f7ac0151ed0 2024-04-25T13:16:29.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7ac6664640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac00ca4a0 con 0x7f7ac015be40 2024-04-25T13:16:29.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ac00c8df0 0x7f7ac0150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ac00c8df0 0x7f7ac0150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41154/0 (socket says 172.21.15.26:41154) 2024-04-25T13:16:29.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 -- 172.21.15.26:0/554901450 learned_addr learned my addr 172.21.15.26:0/554901450 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:29.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7ac4c01640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac015be40 0x7f7ac0137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abf7fe640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 0x7f7ac013d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 -- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac015be40 msgr2=0x7f7ac0137e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac015be40 0x7f7ac0137e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 -- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 msgr2=0x7f7ac013d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 0x7f7ac013d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 -- 172.21.15.26:0/554901450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac013c330 con 0x7f7ac00c8df0 2024-04-25T13:16:29.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abffff640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ac00c8df0 0x7f7ac0150620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0035040 tx=0x7f7ab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.954+0000 7f7abcff9640 1 -- 172.21.15.26:0/554901450 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0041020 con 0x7f7ac00c8df0 2024-04-25T13:16:29.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.955+0000 7f7abcff9640 1 -- 172.21.15.26:0/554901450 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab00044c0 con 0x7f7ac00c8df0 2024-04-25T13:16:29.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.955+0000 7f7abcff9640 1 -- 172.21.15.26:0/554901450 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0037040 con 0x7f7ac00c8df0 2024-04-25T13:16:29.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.955+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac013c610 con 0x7f7ac00c8df0 2024-04-25T13:16:29.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.955+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac013cbd0 con 0x7f7ac00c8df0 2024-04-25T13:16:29.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.956+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac00c5360 con 0x7f7ac00c8df0 2024-04-25T13:16:29.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.956+0000 7f7abcff9640 1 -- 172.21.15.26:0/554901450 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ab0044020 con 0x7f7ac00c8df0 2024-04-25T13:16:29.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.957+0000 7f7abcff9640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7aac06c8f0 0x7f7aac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.957+0000 7f7abcff9640 1 -- 172.21.15.26:0/554901450 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7ab00ac170 con 0x7f7ac00c8df0 2024-04-25T13:16:29.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.957+0000 7f7abf7fe640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7aac06c8f0 0x7f7aac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.957+0000 7f7abf7fe640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7aac06c8f0 0x7f7aac06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0157010 tx=0x7f7ab4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:29.961+0000 7f7abcff9640 1 -- 172.21.15.26:0/554901450 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ac00c5360 con 0x7f7ac00c8df0 2024-04-25T13:16:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.150+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7ac0068e40 con 0x7f7ac00c8df0 2024-04-25T13:16:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.151+0000 7f7abcff9640 1 -- 172.21.15.26:0/554901450 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f7ab004b030 con 0x7f7ac00c8df0 2024-04-25T13:16:30.152 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.152+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7aac06c8f0 msgr2=0x7f7aac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.152+0000 7f7ac6664640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7aac06c8f0 0x7f7aac06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0157010 tx=0x7f7ab4009040 comp rx=0 tx=0).stop 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.152+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ac00c8df0 msgr2=0x7f7ac0150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.152+0000 7f7ac6664640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ac00c8df0 0x7f7ac0150620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0035040 tx=0x7f7ab00046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 shutdown_connections 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7aac06c8f0 0x7f7aac06edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac015be40 0x7f7ac0137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ac0151ed0 0x7f7ac013d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 --2- 172.21.15.26:0/554901450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ac00c8df0 0x7f7ac0150620 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 >> 172.21.15.26:0/554901450 conn(0x7f7ac006b920 msgr2=0x7f7ac006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 shutdown_connections 2024-04-25T13:16:30.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.153+0000 7f7ac6664640 1 -- 172.21.15.26:0/554901450 wait complete. 2024-04-25T13:16:30.165 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:16:30.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.268+0000 7f645b7bb640 1 Processor -- start 2024-04-25T13:16:30.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.268+0000 7f645b7bb640 1 -- start start 2024-04-25T13:16:30.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f645b7bb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6454153150 0x7f645406f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f645b7bb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f645415cdb0 0x7f64540c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f645b7bb640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6454075c50 con 0x7f6454075830 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f645b7bb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f64540caef0 con 0x7f6454153150 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f645b7bb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f64540753a0 con 0x7f645415cdb0 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f6459557640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6454153150 0x7f645406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f6458d56640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6454075830 0x7f64540c6b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36954/0 (socket says 172.21.15.26:36954) 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f6458d56640 1 -- 172.21.15.26:0/2008489162 learned_addr learned my addr 172.21.15.26:0/2008489162 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.269+0000 7f6459d58640 1 --2- 172.21.15.26:0/2008489162 >> v2:172.21.15.169:3300/0 conn(0x7f645415cdb0 0x7f64540c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f6459557640 1 -- 172.21.15.26:0/2008489162 >> v2:172.21.15.169:3300/0 conn(0x7f645415cdb0 msgr2=0x7f64540c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f6459557640 1 --2- 172.21.15.26:0/2008489162 >> v2:172.21.15.169:3300/0 conn(0x7f645415cdb0 0x7f64540c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f6459557640 1 -- 172.21.15.26:0/2008489162 >> v1:172.21.15.26:6789/0 conn(0x7f6454075830 legacy=0x7f64540c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f6459557640 1 -- 172.21.15.26:0/2008489162 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64540c73f0 con 0x7f6454153150 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f6459557640 1 --2- 172.21.15.26:0/2008489162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f645406f880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f645406ef90 tx=0x7f645002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bab33f15b135f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f644bfff640 1 -- 172.21.15.26:0/2008489162 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450037070 con 0x7f6454153150 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f644bfff640 1 -- 172.21.15.26:0/2008489162 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6450032440 con 0x7f6454153150 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.270+0000 7f644bfff640 1 -- 172.21.15.26:0/2008489162 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450032810 con 0x7f6454153150 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 -- 172.21.15.26:0/2008489162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 msgr2=0x7f645406f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 --2- 172.21.15.26:0/2008489162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f645406f880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f645406ef90 tx=0x7f645002a230 comp rx=0 tx=0).stop 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 -- 172.21.15.26:0/2008489162 shutdown_connections 2024-04-25T13:16:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 --2- 172.21.15.26:0/2008489162 >> v2:172.21.15.169:3300/0 conn(0x7f645415cdb0 0x7f64540c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 --2- 172.21.15.26:0/2008489162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f645406f880 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 -- 172.21.15.26:0/2008489162 >> 172.21.15.26:0/2008489162 conn(0x7f64540ca0d0 msgr2=0x7f64540ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 -- 172.21.15.26:0/2008489162 shutdown_connections 2024-04-25T13:16:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.271+0000 7f645b7bb640 1 -- 172.21.15.26:0/2008489162 wait complete. 2024-04-25T13:16:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.272+0000 7f645b7bb640 1 Processor -- start 2024-04-25T13:16:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.272+0000 7f645b7bb640 1 -- start start 2024-04-25T13:16:30.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f645b7bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6454075830 0x7f64541f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:30.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f645b7bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f64541ef230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f645b7bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f645415cdb0 0x7f64541e5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f645b7bb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6454074d50 con 0x7f6454153150 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f645b7bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64540c79b0 con 0x7f645415cdb0 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f645b7bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6454075030 con 0x7f6454075830 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f64541ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f64541ef230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41172/0 (socket says 172.21.15.26:41172) 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 -- 172.21.15.26:0/3961270573 learned_addr learned my addr 172.21.15.26:0/3961270573 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6459557640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6454075830 0x7f64541f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6459d58640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f645415cdb0 0x7f64541e5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 -- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6454075830 msgr2=0x7f64541f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6454075830 0x7f64541f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 -- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f645415cdb0 msgr2=0x7f64541e5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f645415cdb0 0x7f64541e5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6458d56640 1 -- 172.21.15.26:0/3961270573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64541ef770 con 0x7f6454153150 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6459d58640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f645415cdb0 0x7f64541e5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.273+0000 7f6459557640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6454075830 0x7f64541f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.274+0000 7f6458d56640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f64541ef230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f644400c430 tx=0x7f644400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.274+0000 7f6449ffb640 1 -- 172.21.15.26:0/3961270573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444017070 con 0x7f6454153150 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.274+0000 7f6449ffb640 1 -- 172.21.15.26:0/3961270573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444005ce0 con 0x7f6454153150 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.274+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64541f2440 con 0x7f6454153150 2024-04-25T13:16:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.274+0000 7f6449ffb640 1 -- 172.21.15.26:0/3961270573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440072f0 con 0x7f6454153150 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.274+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64541f2a00 con 0x7f6454153150 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.275+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64540705c0 con 0x7f6454153150 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.275+0000 7f6449ffb640 1 -- 172.21.15.26:0/3961270573 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f644401a070 con 0x7f6454153150 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.276+0000 7f6449ffb640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f643806c8f0 0x7f643806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.276+0000 7f6449ffb640 1 -- 172.21.15.26:0/3961270573 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f644408b340 con 0x7f6454153150 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.276+0000 7f6459557640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f643806c8f0 0x7f643806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.276+0000 7f6459557640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f643806c8f0 0x7f643806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6450034000 tx=0x7f645002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.280+0000 7f6449ffb640 1 -- 172.21.15.26:0/3961270573 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64540705c0 con 0x7f6454153150 2024-04-25T13:16:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.475+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6454068e40 con 0x7f6454153150 2024-04-25T13:16:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.475+0000 7f6449ffb640 1 -- 172.21.15.26:0/3961270573 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f64440593a0 con 0x7f6454153150 2024-04-25T13:16:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-25T13:16:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f643806c8f0 msgr2=0x7f643806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f643806c8f0 0x7f643806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6450034000 tx=0x7f645002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 msgr2=0x7f64541ef230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f64541ef230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f644400c430 tx=0x7f644400c8f0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 shutdown_connections 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f643806c8f0 0x7f643806edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f645415cdb0 0x7f64541e5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454153150 0x7f64541ef230 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 --2- 172.21.15.26:0/3961270573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6454075830 0x7f64541f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 >> 172.21.15.26:0/3961270573 conn(0x7f64540ca0d0 msgr2=0x7f64540c49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 shutdown_connections 2024-04-25T13:16:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:30.477+0000 7f645b7bb640 1 -- 172.21.15.26:0/3961270573 wait complete. 2024-04-25T13:16:30.489 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2024-04-25T13:16:30.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:30.489 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:30.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[41187]: fuse finished with error 0 and tester_r 0 2024-04-25T13:16:30.513 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:16:36.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:36.227 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:36.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:16:36.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:36.615 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T13:16:36.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:36.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.796+0000 7f2040c79640 1 Processor -- start 2024-04-25T13:16:36.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.796+0000 7f2040c79640 1 -- start start 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2040c79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f203c0b3c00 0x7f203c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2040c79640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2040c79640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f203c1558c0 con 0x7f203c1554e0 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2040c79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f203c0b4a80 con 0x7f203c0b3c00 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2040c79640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f203c0cb8c0 con 0x7f203c0b5450 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2033fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f203c0b3c00 0x7f203c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2033fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f203c0b3c00 0x7f203c0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36824/0 (socket says 172.21.15.26:36824) 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2033fff640 1 -- 172.21.15.26:0/2991837703 learned_addr learned my addr 172.21.15.26:0/2991837703 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f203ad9d640 1 --2- 172.21.15.26:0/2991837703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2033fff640 1 -- 172.21.15.26:0/2991837703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 msgr2=0x7f203c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:36.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2033fff640 1 --2- 172.21.15.26:0/2991837703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2033fff640 1 -- 172.21.15.26:0/2991837703 >> v1:172.21.15.169:6789/0 conn(0x7f203c1554e0 legacy=0x7f203c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.797+0000 7f2033fff640 1 -- 172.21.15.26:0/2991837703 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c0cbba0 con 0x7f203c0b3c00 2024-04-25T13:16:36.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.798+0000 7f2033fff640 1 --2- 172.21.15.26:0/2991837703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0b4f10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2024009870 tx=0x7f202402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a2af5562c233a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.798+0000 7f2039d9b640 1 -- 172.21.15.26:0/2991837703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024037070 con 0x7f203c0b3c00 2024-04-25T13:16:36.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.798+0000 7f2039d9b640 1 -- 172.21.15.26:0/2991837703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202402ae50 con 0x7f203c0b3c00 2024-04-25T13:16:36.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.798+0000 7f2039d9b640 1 -- 172.21.15.26:0/2991837703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024032860 con 0x7f203c0b3c00 2024-04-25T13:16:36.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 -- 172.21.15.26:0/2991837703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 msgr2=0x7f203c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 --2- 172.21.15.26:0/2991837703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0b4f10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2024009870 tx=0x7f202402a300 comp rx=0 tx=0).stop 2024-04-25T13:16:36.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 -- 172.21.15.26:0/2991837703 shutdown_connections 2024-04-25T13:16:36.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 --2- 172.21.15.26:0/2991837703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 --2- 172.21.15.26:0/2991837703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0b4f10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 -- 172.21.15.26:0/2991837703 >> 172.21.15.26:0/2991837703 conn(0x7f203c074d50 msgr2=0x7f203c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 -- 172.21.15.26:0/2991837703 shutdown_connections 2024-04-25T13:16:36.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.799+0000 7f2040c79640 1 -- 172.21.15.26:0/2991837703 wait complete. 2024-04-25T13:16:36.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.800+0000 7f2040c79640 1 Processor -- start 2024-04-25T13:16:36.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.800+0000 7f2040c79640 1 -- start start 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f2040c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f2040c79640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c1e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f2040c79640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f203c1554e0 0x7f203c1f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f2040c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f203c0b4710 con 0x7f203c0b3c00 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f2040c79640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f203c0b4430 con 0x7f203c1554e0 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f2040c79640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f203c0b3580 con 0x7f203c0b5450 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36840/0 (socket says 172.21.15.26:36840) 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 -- 172.21.15.26:0/4288377094 learned_addr learned my addr 172.21.15.26:0/4288377094 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f2033fff640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c1e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203ad9d640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f203c1554e0 0x7f203c1f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 -- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 msgr2=0x7f203c1e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c1e5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 -- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f203c1554e0 msgr2=0x7f203c1f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f203c1554e0 0x7f203c1f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203a59c640 1 -- 172.21.15.26:0/4288377094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c1e6250 con 0x7f203c0b3c00 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.801+0000 7f203ad9d640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f203c1554e0 0x7f203c1f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.802+0000 7f203a59c640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0cf2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c430 tx=0x7f202c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.802+0000 7f2032ffd640 1 -- 172.21.15.26:0/4288377094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0052d0 con 0x7f203c0b3c00 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.802+0000 7f2032ffd640 1 -- 172.21.15.26:0/4288377094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c005490 con 0x7f203c0b3c00 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.802+0000 7f2032ffd640 1 -- 172.21.15.26:0/4288377094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c007260 con 0x7f203c0b3c00 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.802+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203c1e6530 con 0x7f203c0b3c00 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.802+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203c1f2410 con 0x7f203c0b3c00 2024-04-25T13:16:36.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.803+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f203c068e40 con 0x7f203c0b3c00 2024-04-25T13:16:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.803+0000 7f2032ffd640 1 -- 172.21.15.26:0/4288377094 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f202c007400 con 0x7f203c0b3c00 2024-04-25T13:16:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.804+0000 7f2032ffd640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f201c06c8f0 0x7f201c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.804+0000 7f2032ffd640 1 -- 172.21.15.26:0/4288377094 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f202c08b490 con 0x7f203c0b3c00 2024-04-25T13:16:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.804+0000 7f2033fff640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f201c06c8f0 0x7f201c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.805+0000 7f2033fff640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f201c06c8f0 0x7f201c06edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2024034000 tx=0x7f202402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.809+0000 7f2032ffd640 1 -- 172.21.15.26:0/4288377094 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f203c1558c0 con 0x7f203c0b3c00 2024-04-25T13:16:36.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.995+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f203c0b6490 con 0x7f203c0b3c00 2024-04-25T13:16:36.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.996+0000 7f2032ffd640 1 -- 172.21.15.26:0/4288377094 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f202c059500 con 0x7f203c0b3c00 2024-04-25T13:16:36.997 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:36.997 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:36.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f201c06c8f0 msgr2=0x7f201c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f201c06c8f0 0x7f201c06edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2024034000 tx=0x7f202402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:36.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 msgr2=0x7f203c0cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0cf2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c430 tx=0x7f202c00c8f0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 shutdown_connections 2024-04-25T13:16:37.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f201c06c8f0 0x7f201c06edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f203c1554e0 0x7f203c1f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f203c0b5450 0x7f203c1e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 --2- 172.21.15.26:0/4288377094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f203c0b3c00 0x7f203c0cf2b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 >> 172.21.15.26:0/4288377094 conn(0x7f203c074d50 msgr2=0x7f203c0cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 shutdown_connections 2024-04-25T13:16:37.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:36.998+0000 7f2040c79640 1 -- 172.21.15.26:0/4288377094 wait complete. 2024-04-25T13:16:37.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:37.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.110+0000 7f746c879640 1 Processor -- start 2024-04-25T13:16:37.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.110+0000 7f746c879640 1 -- start start 2024-04-25T13:16:37.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746c879640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f746806e850 0x7f74680c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746c879640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746806f270 con 0x7f746806ec30 2024-04-25T13:16:37.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746c879640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74680c6fa0 con 0x7f74680c8160 2024-04-25T13:16:37.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746c879640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f74680c7bb0 con 0x7f746806e850 2024-04-25T13:16:37.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f746806e850 0x7f74680c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f7466d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f746806ec30 0x7f7468165940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58554/0 (socket says 172.21.15.26:58554) 2024-04-25T13:16:37.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f7466d9d640 1 -- 172.21.15.26:0/192710963 learned_addr learned my addr 172.21.15.26:0/192710963 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:37.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746659c640 1 -- 172.21.15.26:0/192710963 >> v1:172.21.15.169:6789/0 conn(0x7f74680c8160 legacy=0x7f7468154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746659c640 1 -- 172.21.15.26:0/192710963 >> v1:172.21.15.26:6789/0 conn(0x7f746806ec30 legacy=0x7f7468165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.111+0000 7f746659c640 1 -- 172.21.15.26:0/192710963 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680c7280 con 0x7f746806e850 2024-04-25T13:16:37.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.112+0000 7f746659c640 1 --2- 172.21.15.26:0/192710963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f74680c3b80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f74580097a0 tx=0x7f745802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4140f24518c0a07a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.112+0000 7f7465d9b640 1 -- 172.21.15.26:0/192710963 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458037070 con 0x7f746806e850 2024-04-25T13:16:37.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.112+0000 7f7465d9b640 1 -- 172.21.15.26:0/192710963 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745802adf0 con 0x7f746806e850 2024-04-25T13:16:37.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.112+0000 7f7465d9b640 1 -- 172.21.15.26:0/192710963 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458032660 con 0x7f746806e850 2024-04-25T13:16:37.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.113+0000 7f746c879640 1 -- 172.21.15.26:0/192710963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 msgr2=0x7f74680c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.113+0000 7f746c879640 1 --2- 172.21.15.26:0/192710963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f74680c3b80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f74580097a0 tx=0x7f745802a160 comp rx=0 tx=0).stop 2024-04-25T13:16:37.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.113+0000 7f746c879640 1 -- 172.21.15.26:0/192710963 shutdown_connections 2024-04-25T13:16:37.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.113+0000 7f746c879640 1 --2- 172.21.15.26:0/192710963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f74680c3b80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.113+0000 7f746c879640 1 -- 172.21.15.26:0/192710963 >> 172.21.15.26:0/192710963 conn(0x7f74680c8f00 msgr2=0x7f74680c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.113+0000 7f746c879640 1 -- 172.21.15.26:0/192710963 shutdown_connections 2024-04-25T13:16:37.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.113+0000 7f746c879640 1 -- 172.21.15.26:0/192710963 wait complete. 2024-04-25T13:16:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.114+0000 7f746c879640 1 Processor -- start 2024-04-25T13:16:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.114+0000 7f746c879640 1 -- start start 2024-04-25T13:16:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746c879640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f746814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746c879640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f746806ec30 0x7f74680cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746c879640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74680c8160 0x7f74681e6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746c879640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f746806f4a0 con 0x7f746806e850 2024-04-25T13:16:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746c879640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74680c7840 con 0x7f746806ec30 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746c879640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f746806f620 con 0x7f74680c8160 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f746814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f746814ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36850/0 (socket says 172.21.15.26:36850) 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 -- 172.21.15.26:0/1249070171 learned_addr learned my addr 172.21.15.26:0/1249070171 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f7466d9d640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74680c8160 0x7f74681e6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f745ffff640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f746806ec30 0x7f74680cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 -- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74680c8160 msgr2=0x7f74681e6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74680c8160 0x7f74681e6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 -- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f746806ec30 msgr2=0x7f74680cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f746806ec30 0x7f74680cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 -- 172.21.15.26:0/1249070171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680cc820 con 0x7f746806e850 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f7466d9d640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74680c8160 0x7f74681e6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f746659c640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f746814ad30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7458035040 tx=0x7f74580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.115+0000 7f745effd640 1 -- 172.21.15.26:0/1249070171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458037040 con 0x7f746806e850 2024-04-25T13:16:37.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.116+0000 7f745effd640 1 -- 172.21.15.26:0/1249070171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7458004030 con 0x7f746806e850 2024-04-25T13:16:37.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.116+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74680cc260 con 0x7f746806e850 2024-04-25T13:16:37.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.116+0000 7f745effd640 1 -- 172.21.15.26:0/1249070171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458004420 con 0x7f746806e850 2024-04-25T13:16:37.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.116+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74680ca430 con 0x7f746806e850 2024-04-25T13:16:37.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.116+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7468068e40 con 0x7f746806e850 2024-04-25T13:16:37.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.117+0000 7f745effd640 1 -- 172.21.15.26:0/1249070171 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f745803a040 con 0x7f746806e850 2024-04-25T13:16:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.117+0000 7f745effd640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f744806c8f0 0x7f744806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.117+0000 7f745effd640 1 -- 172.21.15.26:0/1249070171 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f74580ac6a0 con 0x7f746806e850 2024-04-25T13:16:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.118+0000 7f745ffff640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f744806c8f0 0x7f744806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.118+0000 7f745ffff640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f744806c8f0 0x7f744806edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f746815a7f0 tx=0x7f7450008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.122+0000 7f745effd640 1 -- 172.21.15.26:0/1249070171 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74680cc820 con 0x7f746806e850 2024-04-25T13:16:37.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.310+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7468152c20 con 0x7f746806e850 2024-04-25T13:16:37.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.311+0000 7f745effd640 1 -- 172.21.15.26:0/1249070171 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f7458042070 con 0x7f746806e850 2024-04-25T13:16:37.312 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:37.312 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f744806c8f0 msgr2=0x7f744806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f744806c8f0 0x7f744806edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f746815a7f0 tx=0x7f7450008040 comp rx=0 tx=0).stop 2024-04-25T13:16:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 msgr2=0x7f746814ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f746814ad30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7458035040 tx=0x7f74580046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 shutdown_connections 2024-04-25T13:16:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f744806c8f0 0x7f744806edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74680c8160 0x7f74681e6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f746806ec30 0x7f74680cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 --2- 172.21.15.26:0/1249070171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746806e850 0x7f746814ad30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 >> 172.21.15.26:0/1249070171 conn(0x7f74680c8f00 msgr2=0x7f746814fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 shutdown_connections 2024-04-25T13:16:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.313+0000 7f746c879640 1 -- 172.21.15.26:0/1249070171 wait complete. 2024-04-25T13:16:37.325 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T13:16:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.428+0000 7fd22283c640 1 Processor -- start 2024-04-25T13:16:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.428+0000 7fd22283c640 1 -- start start 2024-04-25T13:16:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd22283c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd21c1553c0 0x7fd21c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd22283c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c15f310 0x7fd21c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd22283c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c0c5c80 con 0x7fd21c15b070 2024-04-25T13:16:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd22283c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c15e660 con 0x7fd21c1553c0 2024-04-25T13:16:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd22283c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c1557a0 con 0x7fd21c15f310 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd21bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd21c1553c0 0x7fd21c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd220dd9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd21c15b070 0x7fd21c0d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58558/0 (socket says 172.21.15.26:58558) 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.429+0000 7fd220dd9640 1 -- 172.21.15.26:0/3774339840 learned_addr learned my addr 172.21.15.26:0/3774339840 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.430+0000 7fd21b7fe640 1 --2- 172.21.15.26:0/3774339840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c15f310 0x7fd21c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.430+0000 7fd21bfff640 1 -- 172.21.15.26:0/3774339840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c15f310 msgr2=0x7fd21c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.430+0000 7fd21bfff640 1 --2- 172.21.15.26:0/3774339840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c15f310 0x7fd21c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.430+0000 7fd21bfff640 1 -- 172.21.15.26:0/3774339840 >> v1:172.21.15.26:6789/0 conn(0x7fd21c15b070 legacy=0x7fd21c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.430+0000 7fd21affd640 1 -- 172.21.15.26:0/3774339840 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090236924 0 0) 0x7fd21c0c5c80 con 0x7fd21c15b070 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.430+0000 7fd21bfff640 1 -- 172.21.15.26:0/3774339840 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c15b5d0 con 0x7fd21c1553c0 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.430+0000 7fd21bfff640 1 --2- 172.21.15.26:0/3774339840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c1553c0 0x7fd21c15edd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd204009790 tx=0x7fd20402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c6204665cc7d7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd21affd640 1 -- 172.21.15.26:0/3774339840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204037070 con 0x7fd21c1553c0 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd21affd640 1 -- 172.21.15.26:0/3774339840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204032440 con 0x7fd21c1553c0 2024-04-25T13:16:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd21affd640 1 -- 172.21.15.26:0/3774339840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204032810 con 0x7fd21c1553c0 2024-04-25T13:16:37.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 -- 172.21.15.26:0/3774339840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c1553c0 msgr2=0x7fd21c15edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 --2- 172.21.15.26:0/3774339840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c1553c0 0x7fd21c15edd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd204009790 tx=0x7fd20402a180 comp rx=0 tx=0).stop 2024-04-25T13:16:37.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 -- 172.21.15.26:0/3774339840 shutdown_connections 2024-04-25T13:16:37.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 --2- 172.21.15.26:0/3774339840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c15f310 0x7fd21c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 --2- 172.21.15.26:0/3774339840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c1553c0 0x7fd21c15edd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 -- 172.21.15.26:0/3774339840 >> 172.21.15.26:0/3774339840 conn(0x7fd21c072360 msgr2=0x7fd21c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 -- 172.21.15.26:0/3774339840 shutdown_connections 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.431+0000 7fd22283c640 1 -- 172.21.15.26:0/3774339840 wait complete. 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.432+0000 7fd22283c640 1 Processor -- start 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.432+0000 7fd22283c640 1 -- start start 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd22283c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c1553c0 0x7fd21c0d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd22283c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c15b070 0x7fd21c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd22283c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c15f310 0x7fd21c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd22283c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15be70 con 0x7fd21c15f310 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd22283c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15bb90 con 0x7fd21c15b070 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd22283c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c15e8b0 con 0x7fd21c1553c0 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd220dd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c15f310 0x7fd21c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd220dd9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c15f310 0x7fd21c155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36862/0 (socket says 172.21.15.26:36862) 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd220dd9640 1 -- 172.21.15.26:0/3409158009 learned_addr learned my addr 172.21.15.26:0/3409158009 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:37.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.433+0000 7fd21bfff640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c1553c0 0x7fd21c0d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd220dd9640 1 -- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c1553c0 msgr2=0x7fd21c0d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd220dd9640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c1553c0 0x7fd21c0d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd220dd9640 1 -- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c15b070 msgr2=0x7fd21c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd21b7fe640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c15b070 0x7fd21c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd220dd9640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c15b070 0x7fd21c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd220dd9640 1 -- 172.21.15.26:0/3409158009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c1f1c00 con 0x7fd21c15f310 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd220dd9640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c15f310 0x7fd21c155ec0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c7d0 tx=0x7fd21400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd218ff9640 1 -- 172.21.15.26:0/3409158009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214018070 con 0x7fd21c15f310 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd218ff9640 1 -- 172.21.15.26:0/3409158009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21400a640 con 0x7fd21c15f310 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c0cfb40 con 0x7fd21c15f310 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd218ff9640 1 -- 172.21.15.26:0/3409158009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21400aa30 con 0x7fd21c15f310 2024-04-25T13:16:37.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.434+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c0ce9e0 con 0x7fd21c15f310 2024-04-25T13:16:37.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.435+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c068f50 con 0x7fd21c15f310 2024-04-25T13:16:37.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.435+0000 7fd218ff9640 1 -- 172.21.15.26:0/3409158009 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd21401b070 con 0x7fd21c15f310 2024-04-25T13:16:37.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.436+0000 7fd218ff9640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.436+0000 7fd218ff9640 1 -- 172.21.15.26:0/3409158009 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd21408b410 con 0x7fd21c15f310 2024-04-25T13:16:37.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.436+0000 7fd21bfff640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.437+0000 7fd21bfff640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd204034000 tx=0x7fd20402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.440+0000 7fd218ff9640 1 -- 172.21.15.26:0/3409158009 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd214059590 con 0x7fd21c15f310 2024-04-25T13:16:37.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:37.667+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd21c0cc0e0 con 0x7fd21c15f310 2024-04-25T13:16:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.306+0000 7fd218ff9640 1 -- 172.21.15.26:0/3409158009 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fd214058e90 con 0x7fd21c15f310 2024-04-25T13:16:38.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd1fc06c8f0 msgr2=0x7fd1fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd204034000 tx=0x7fd20402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c15f310 msgr2=0x7fd21c155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c15f310 0x7fd21c155ec0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c7d0 tx=0x7fd21400cc90 comp rx=0 tx=0).stop 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 shutdown_connections 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21c15f310 0x7fd21c155ec0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c15b070 0x7fd21c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 --2- 172.21.15.26:0/3409158009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c1553c0 0x7fd21c0d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.308+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 >> 172.21.15.26:0/3409158009 conn(0x7fd21c072360 msgr2=0x7fd21c0c6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.309+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 shutdown_connections 2024-04-25T13:16:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.309+0000 7fd22283c640 1 -- 172.21.15.26:0/3409158009 wait complete. 2024-04-25T13:16:38.322 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-25T13:16:38.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-25T13:16:38.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.430+0000 7f3080643640 1 Processor -- start 2024-04-25T13:16:38.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.430+0000 7f3080643640 1 -- start start 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.431+0000 7f3080643640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 0x7f307815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.431+0000 7f3080643640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780c5c80 con 0x7f307815b070 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.431+0000 7f3080643640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307815b5d0 con 0x7f307815f310 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.431+0000 7f3080643640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f307815e660 con 0x7f30781553c0 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.431+0000 7f307ebe0640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f307815b070 0x7f30780d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58564/0 (socket says 172.21.15.26:58564) 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.431+0000 7f307ebe0640 1 -- 172.21.15.26:0/4243267701 learned_addr learned my addr 172.21.15.26:0/4243267701 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244965978 0 0) 0x7f30780c5c80 con 0x7f307815b070 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307e3df640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 0x7f307815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3064003520 con 0x7f307815b070 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044104238 0 0) 0x7f3064003520 con 0x7f307815b070 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 msgr2=0x7f307815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 0x7f307815edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 >> v1:172.21.15.169:6789/0 conn(0x7f307815f310 legacy=0x7f30780cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307815b8b0 con 0x7f307815b070 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f30700019f0 con 0x7f307815b070 2024-04-25T13:16:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 >> v1:172.21.15.26:6789/0 conn(0x7f307815b070 legacy=0x7f30780d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f3064003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 0x7f3064004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064004d40 0x7f30640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f307815e660 con 0x7f30640039e0 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3064014360 con 0x7f3064004d40 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3064014530 con 0x7f30781553c0 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307e3df640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f3064003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307ebe0640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064004d40 0x7f30640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307dbde640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 0x7f3064004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307e3df640 1 -- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 msgr2=0x7f3064004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307e3df640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30781553c0 0x7f3064004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307e3df640 1 -- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064004d40 msgr2=0x7f30640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307e3df640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064004d40 0x7f30640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.432+0000 7f307e3df640 1 -- 172.21.15.26:0/4243267701 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3064003520 con 0x7f30640039e0 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.433+0000 7f307e3df640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f3064003e20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3074009ab0 tx=0x7f3064005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578b0a53747b1708 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.433+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074036070 con 0x7f30640039e0 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.433+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074005990 con 0x7f30640039e0 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.433+0000 7f307d3dd640 1 -- 172.21.15.26:0/4243267701 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074009680 con 0x7f30640039e0 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.434+0000 7f3080643640 1 -- 172.21.15.26:0/4243267701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 msgr2=0x7f3064003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.434+0000 7f3080643640 1 --2- 172.21.15.26:0/4243267701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f3064003e20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3074009ab0 tx=0x7f3064005830 comp rx=0 tx=0).stop 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.434+0000 7f307ebe0640 1 -- 172.21.15.26:0/4243267701 reap_dead start 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.434+0000 7f3080643640 1 -- 172.21.15.26:0/4243267701 shutdown_connections 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.434+0000 7f3080643640 1 -- 172.21.15.26:0/4243267701 >> 172.21.15.26:0/4243267701 conn(0x7f3078072360 msgr2=0x7f3078074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.434+0000 7f3080643640 1 -- 172.21.15.26:0/4243267701 shutdown_connections 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.434+0000 7f3080643640 1 -- 172.21.15.26:0/4243267701 wait complete. 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.435+0000 7f3080643640 1 Processor -- start 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.435+0000 7f3080643640 1 -- start start 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f3080643640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f307815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f3080643640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307815c230 0x7f307815da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f3080643640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307815d340 0x7f307814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f3080643640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f307815be70 con 0x7f30640039e0 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f3080643640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30781557a0 con 0x7f307815c230 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f3080643640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f307815e8b0 con 0x7f307815d340 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f307815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f307815c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36878/0 (socket says 172.21.15.26:36878) 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 -- 172.21.15.26:0/3587474348 learned_addr learned my addr 172.21.15.26:0/3587474348 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307ebe0640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307815d340 0x7f307814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307dbde640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307815c230 0x7f307815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 -- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307815d340 msgr2=0x7f307814e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307815d340 0x7f307814e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 -- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307815c230 msgr2=0x7f307815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307815c230 0x7f307815da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 -- 172.21.15.26:0/3587474348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307814fcb0 con 0x7f30640039e0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307dbde640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307815c230 0x7f307815da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.436+0000 7f307e3df640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f307815c780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3074009ba0 tx=0x7f3074004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.437+0000 7f306effd640 1 -- 172.21.15.26:0/3587474348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074036070 con 0x7f30640039e0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.437+0000 7f306effd640 1 -- 172.21.15.26:0/3587474348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074037040 con 0x7f30640039e0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.437+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3078150cb0 con 0x7f30640039e0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.437+0000 7f306effd640 1 -- 172.21.15.26:0/3587474348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074004030 con 0x7f30640039e0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.437+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30781ecc90 con 0x7f30640039e0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.438+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307815e470 con 0x7f30640039e0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.438+0000 7f306effd640 1 -- 172.21.15.26:0/3587474348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30740041d0 con 0x7f30640039e0 2024-04-25T13:16:38.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.439+0000 7f306effd640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f305c06c8f0 0x7f305c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.439+0000 7f306effd640 1 -- 172.21.15.26:0/3587474348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f30740abef0 con 0x7f30640039e0 2024-04-25T13:16:38.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.439+0000 7f307dbde640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f305c06c8f0 0x7f305c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.439+0000 7f307dbde640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f305c06c8f0 0x7f305c06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3078150060 tx=0x7f3068009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.443+0000 7f306effd640 1 -- 172.21.15.26:0/3587474348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f307814fcb0 con 0x7f30640039e0 2024-04-25T13:16:38.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:38.665+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f3078068f50 con 0x7f30640039e0 2024-04-25T13:16:39.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.311+0000 7f306effd640 1 -- 172.21.15.26:0/3587474348 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7f3074079a20 con 0x7f30640039e0 2024-04-25T13:16:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f305c06c8f0 msgr2=0x7f305c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f305c06c8f0 0x7f305c06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3078150060 tx=0x7f3068009040 comp rx=0 tx=0).stop 2024-04-25T13:16:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 msgr2=0x7f307815c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f307815c780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3074009ba0 tx=0x7f3074004730 comp rx=0 tx=0).stop 2024-04-25T13:16:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 shutdown_connections 2024-04-25T13:16:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f305c06c8f0 0x7f305c06edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307815d340 0x7f307814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307815c230 0x7f307815da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 --2- 172.21.15.26:0/3587474348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30640039e0 0x7f307815c780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 >> 172.21.15.26:0/3587474348 conn(0x7f3078072360 msgr2=0x7f30780b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 shutdown_connections 2024-04-25T13:16:39.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.314+0000 7f3080643640 1 -- 172.21.15.26:0/3587474348 wait complete. 2024-04-25T13:16:39.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T13:16:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.438+0000 7f7bf8679640 1 Processor -- start 2024-04-25T13:16:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.438+0000 7f7bf8679640 1 -- start start 2024-04-25T13:16:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf8679640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bf0154f00 0x7f7bf0073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf8679640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7bf00cc710 0x7f7bf0073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf8679640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf015be60 con 0x7f7bf00b3600 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf8679640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf015e650 con 0x7f7bf0154f00 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf8679640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf015e930 con 0x7f7bf00cc710 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf6415640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bf0154f00 0x7f7bf0073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf5c14640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7bf00b3600 0x7f7bf00cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58570/0 (socket says 172.21.15.26:58570) 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf5c14640 1 -- 172.21.15.26:0/3789617380 learned_addr learned my addr 172.21.15.26:0/3789617380 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf6c16640 1 --2- 172.21.15.26:0/3789617380 >> v2:172.21.15.169:3300/0 conn(0x7f7bf00cc710 0x7f7bf0073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf6415640 1 -- 172.21.15.26:0/3789617380 >> v2:172.21.15.169:3300/0 conn(0x7f7bf00cc710 msgr2=0x7f7bf0073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf6415640 1 --2- 172.21.15.26:0/3789617380 >> v2:172.21.15.169:3300/0 conn(0x7f7bf00cc710 0x7f7bf0073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf6415640 1 -- 172.21.15.26:0/3789617380 >> v1:172.21.15.26:6789/0 conn(0x7f7bf00b3600 legacy=0x7f7bf00cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf5413640 1 -- 172.21.15.26:0/3789617380 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765792463 0 0) 0x7f7bf015be60 con 0x7f7bf00b3600 2024-04-25T13:16:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.439+0000 7f7bf6415640 1 -- 172.21.15.26:0/3789617380 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf015ec10 con 0x7f7bf0154f00 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.440+0000 7f7bf6415640 1 --2- 172.21.15.26:0/3789617380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf0073110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00ce450 tx=0x7f7be802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a575e60128c9b633 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.440+0000 7f7bf5413640 1 -- 172.21.15.26:0/3789617380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8037070 con 0x7f7bf0154f00 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.440+0000 7f7bf5413640 1 -- 172.21.15.26:0/3789617380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be8032440 con 0x7f7bf0154f00 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.440+0000 7f7bf5413640 1 -- 172.21.15.26:0/3789617380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8032810 con 0x7f7bf0154f00 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 -- 172.21.15.26:0/3789617380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 msgr2=0x7f7bf0073110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 --2- 172.21.15.26:0/3789617380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf0073110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00ce450 tx=0x7f7be802a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 -- 172.21.15.26:0/3789617380 shutdown_connections 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 --2- 172.21.15.26:0/3789617380 >> v2:172.21.15.169:3300/0 conn(0x7f7bf00cc710 0x7f7bf0073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 --2- 172.21.15.26:0/3789617380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf0073110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 -- 172.21.15.26:0/3789617380 >> 172.21.15.26:0/3789617380 conn(0x7f7bf0068570 msgr2=0x7f7bf0071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 -- 172.21.15.26:0/3789617380 shutdown_connections 2024-04-25T13:16:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.441+0000 7f7bf8679640 1 -- 172.21.15.26:0/3789617380 wait complete. 2024-04-25T13:16:39.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.442+0000 7f7bf8679640 1 Processor -- start 2024-04-25T13:16:39.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.442+0000 7f7bf8679640 1 -- start start 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf8679640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf00b3600 0x7f7bf01f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf8679640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf00cc710 0x7f7bf015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf8679640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf00cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf8679640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01552e0 con 0x7f7bf0154f00 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf8679640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf00cb230 con 0x7f7bf00cc710 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf8679640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf01f1390 con 0x7f7bf00b3600 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf00cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf00cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36898/0 (socket says 172.21.15.26:36898) 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 -- 172.21.15.26:0/737733225 learned_addr learned my addr 172.21.15.26:0/737733225 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6415640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf00b3600 0x7f7bf01f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 -- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf00b3600 msgr2=0x7f7bf01f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf00b3600 0x7f7bf01f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 -- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf00cc710 msgr2=0x7f7bf015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf5c14640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf00cc710 0x7f7bf015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf00cc710 0x7f7bf015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6c16640 1 -- 172.21.15.26:0/737733225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf01f0d80 con 0x7f7bf0154f00 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.443+0000 7f7bf6415640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf00b3600 0x7f7bf01f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.444+0000 7f7bf6c16640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf00cfa80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7be0007e40 tx=0x7f7be000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.444+0000 7f7beeffd640 1 -- 172.21.15.26:0/737733225 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0014620 con 0x7f7bf0154f00 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.444+0000 7f7beeffd640 1 -- 172.21.15.26:0/737733225 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be0019070 con 0x7f7bf0154f00 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.444+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf015dd20 con 0x7f7bf0154f00 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.444+0000 7f7beeffd640 1 -- 172.21.15.26:0/737733225 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0014a20 con 0x7f7bf0154f00 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.444+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf01f1020 con 0x7f7bf0154f00 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.445+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf0068f50 con 0x7f7bf0154f00 2024-04-25T13:16:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.445+0000 7f7beeffd640 1 -- 172.21.15.26:0/737733225 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7be0014bc0 con 0x7f7bf0154f00 2024-04-25T13:16:39.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.446+0000 7f7beeffd640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7bdc06c920 0x7f7bdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.446+0000 7f7beeffd640 1 -- 172.21.15.26:0/737733225 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7be008c830 con 0x7f7bf0154f00 2024-04-25T13:16:39.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.446+0000 7f7bf6415640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7bdc06c920 0x7f7bdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.447+0000 7f7bf6415640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7bdc06c920 0x7f7bdc06ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7be8034000 tx=0x7f7be802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.450+0000 7f7beeffd640 1 -- 172.21.15.26:0/737733225 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7be005a890 con 0x7f7bf0154f00 2024-04-25T13:16:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:39.674+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7bf01588e0 con 0x7f7bf0154f00 2024-04-25T13:16:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.317+0000 7f7beeffd640 1 -- 172.21.15.26:0/737733225 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f7be005a190 con 0x7f7bf0154f00 2024-04-25T13:16:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7bdc06c920 msgr2=0x7f7bdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7bdc06c920 0x7f7bdc06ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7be8034000 tx=0x7f7be802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 msgr2=0x7f7bf00cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf00cfa80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7be0007e40 tx=0x7f7be000e4b0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 shutdown_connections 2024-04-25T13:16:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f7bdc06c920 0x7f7bdc06ede0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf0154f00 0x7f7bf00cfa80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf00cc710 0x7f7bf015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 --2- 172.21.15.26:0/737733225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf00b3600 0x7f7bf01f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 >> 172.21.15.26:0/737733225 conn(0x7f7bf0068570 msgr2=0x7f7bf00c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 shutdown_connections 2024-04-25T13:16:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.320+0000 7f7bf8679640 1 -- 172.21.15.26:0/737733225 wait complete. 2024-04-25T13:16:40.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T13:16:40.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.444+0000 7f8d1ca33640 1 Processor -- start 2024-04-25T13:16:40.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.444+0000 7f8d1ca33640 1 -- start start 2024-04-25T13:16:40.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d1ca33640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8d1815b200 0x7f8d1815c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d1ca33640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1815cf40 con 0x7f8d1815cad0 2024-04-25T13:16:40.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d1ca33640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d180c8960 con 0x7f8d18155330 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d1ca33640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8d180c8c40 con 0x7f8d1815b200 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d16d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d1815cad0 0x7f8d180c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58582/0 (socket says 172.21.15.26:58582) 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d16d9d640 1 -- 172.21.15.26:0/2344389598 learned_addr learned my addr 172.21.15.26:0/2344389598 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2344389598 >> v2:172.21.15.169:3300/0 conn(0x7f8d1815b200 0x7f8d1815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397693200 0 0) 0x7f8d1815cf40 con 0x7f8d1815cad0 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d04003520 con 0x7f8d1815cad0 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363391872 0 0) 0x7f8d180c8960 con 0x7f8d18155330 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d1815cf40 con 0x7f8d18155330 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1805937756 0 0) 0x7f8d04003520 con 0x7f8d1815cad0 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 >> v2:172.21.15.169:3300/0 conn(0x7f8d1815b200 msgr2=0x7f8d1815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 --2- 172.21.15.26:0/2344389598 >> v2:172.21.15.169:3300/0 conn(0x7f8d1815b200 0x7f8d1815c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 >> v1:172.21.15.169:6789/0 conn(0x7f8d18155330 legacy=0x7f8d180d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d180c8f20 con 0x7f8d1815cad0 2024-04-25T13:16:40.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f8d100019f0 con 0x7f8d1815cad0 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2344389598 >> v2:172.21.15.169:3300/0 conn(0x7f8d1815b200 0x7f8d1815c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 >> v1:172.21.15.26:6789/0 conn(0x7f8d1815cad0 legacy=0x7f8d180c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04003b40 0x7f8d04003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.445+0000 7f8d15d9b640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d04004800 0x7f8d04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d15d9b640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d040051c0 0x7f8d0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d180c8c40 con 0x7f8d04004800 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0400bfb0 con 0x7f8d040051c0 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0400c1b0 con 0x7f8d04003b40 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d04004800 0x7f8d04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d16d9d640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d040051c0 0x7f8d0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d1659c640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04003b40 0x7f8d04003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d0ffff640 1 -- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04003b40 msgr2=0x7f8d04003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04003b40 0x7f8d04003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d0ffff640 1 -- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d040051c0 msgr2=0x7f8d0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d040051c0 0x7f8d0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d0ffff640 1 -- 172.21.15.26:0/2344389598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d04003520 con 0x7f8d04004800 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d16d9d640 1 -- 172.21.15.26:0/2344389598 reap_dead start 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.446+0000 7f8d1659c640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04003b40 0x7f8d04003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d04004800 0x7f8d04004c80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009c60 tx=0x7f8d04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbc011378e60ab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00036070 con 0x7f8d04004800 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d00031400 con 0x7f8d04004800 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d15d9b640 1 -- 172.21.15.26:0/2344389598 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00009860 con 0x7f8d04004800 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2344389598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d04004800 msgr2=0x7f8d04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d04004800 0x7f8d04004c80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009c60 tx=0x7f8d04005830 comp rx=0 tx=0).stop 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2344389598 shutdown_connections 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2344389598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d04004800 0x7f8d04004c80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2344389598 >> 172.21.15.26:0/2344389598 conn(0x7f8d18072570 msgr2=0x7f8d18074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2344389598 shutdown_connections 2024-04-25T13:16:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.447+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2344389598 wait complete. 2024-04-25T13:16:40.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 Processor -- start 2024-04-25T13:16:40.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 -- start start 2024-04-25T13:16:40.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04004800 0x7f8d1814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d18154430 0x7f8d180ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d18154870 0x7f8d180cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d180c97c0 con 0x7f8d18154430 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d180c94e0 con 0x7f8d18154870 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d1ca33640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8d18155710 con 0x7f8d04004800 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.449+0000 7f8d0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d18154430 0x7f8d180ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d18154430 0x7f8d180ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36916/0 (socket says 172.21.15.26:36916) 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 -- 172.21.15.26:0/2177210182 learned_addr learned my addr 172.21.15.26:0/2177210182 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d1659c640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04004800 0x7f8d1814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d16d9d640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d18154870 0x7f8d180cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 -- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04004800 msgr2=0x7f8d1814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04004800 0x7f8d1814e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 -- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d18154870 msgr2=0x7f8d180cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d18154870 0x7f8d180cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 -- 172.21.15.26:0/2177210182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d18152cf0 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d1659c640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04004800 0x7f8d1814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0ffff640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d18154430 0x7f8d180ced50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009d80 tx=0x7f8d00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0effd640 1 -- 172.21.15.26:0/2177210182 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00040070 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0effd640 1 -- 172.21.15.26:0/2177210182 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0003b680 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d18152fd0 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d0effd640 1 -- 172.21.15.26:0/2177210182 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00036040 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.450+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d180cc250 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.451+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d180c8960 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.452+0000 7f8d0effd640 1 -- 172.21.15.26:0/2177210182 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d00043070 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.452+0000 7f8d0effd640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8cf806c8f0 0x7f8cf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.452+0000 7f8d0effd640 1 -- 172.21.15.26:0/2177210182 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8d000ac460 con 0x7f8d18154430 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.453+0000 7f8d1659c640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8cf806c8f0 0x7f8cf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.453+0000 7f8d1659c640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8cf806c8f0 0x7f8cf806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8d180515e0 tx=0x7f8d08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.457+0000 7f8d0effd640 1 -- 172.21.15.26:0/2177210182 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d180c8960 con 0x7f8d18154430 2024-04-25T13:16:40.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:40.683+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f8d18152230 con 0x7f8d18154430 2024-04-25T13:16:41.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.321+0000 7f8d0effd640 1 -- 172.21.15.26:0/2177210182 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f8d00079e70 con 0x7f8d18154430 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8cf806c8f0 msgr2=0x7f8cf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8cf806c8f0 0x7f8cf806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8d180515e0 tx=0x7f8d08009040 comp rx=0 tx=0).stop 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d18154430 msgr2=0x7f8d180ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d18154430 0x7f8d180ced50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009d80 tx=0x7f8d00004730 comp rx=0 tx=0).stop 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 shutdown_connections 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8cf806c8f0 0x7f8cf806edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d18154870 0x7f8d180cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d18154430 0x7f8d180ced50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 --2- 172.21.15.26:0/2177210182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d04004800 0x7f8d1814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 >> 172.21.15.26:0/2177210182 conn(0x7f8d18072570 msgr2=0x7f8d18159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 shutdown_connections 2024-04-25T13:16:41.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.324+0000 7f8d1ca33640 1 -- 172.21.15.26:0/2177210182 wait complete. 2024-04-25T13:16:41.337 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T13:16:41.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:41.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.441+0000 7fcc5a889640 1 Processor -- start 2024-04-25T13:16:41.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.441+0000 7fcc5a889640 1 -- start start 2024-04-25T13:16:41.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.441+0000 7fcc5a889640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc540b3c00 0x7fcc540b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc5a889640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc541558c0 con 0x7fcc540b5450 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc5a889640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc540cb8c0 con 0x7fcc541554e0 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc5a889640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcc540b4a80 con 0x7fcc540b3c00 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc58e26640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcc540b5450 0x7fcc540d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58590/0 (socket says 172.21.15.26:58590) 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc58e26640 1 -- 172.21.15.26:0/1488285562 learned_addr learned my addr 172.21.15.26:0/1488285562 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc537fe640 1 --2- 172.21.15.26:0/1488285562 >> v2:172.21.15.26:3300/0 conn(0x7fcc540b3c00 0x7fcc540b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc52ffd640 1 -- 172.21.15.26:0/1488285562 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507143059 0 0) 0x7fcc4c001490 con 0x7fcc540b5450 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc52ffd640 1 -- 172.21.15.26:0/1488285562 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc3c003520 con 0x7fcc540b5450 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc537fe640 1 -- 172.21.15.26:0/1488285562 >> v1:172.21.15.169:6789/0 conn(0x7fcc541554e0 legacy=0x7fcc5415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc537fe640 1 -- 172.21.15.26:0/1488285562 >> v1:172.21.15.26:6789/0 conn(0x7fcc540b5450 legacy=0x7fcc540d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.442+0000 7fcc537fe640 1 -- 172.21.15.26:0/1488285562 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc540cbba0 con 0x7fcc540b3c00 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc537fe640 1 --2- 172.21.15.26:0/1488285562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540b4f10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcc480097a0 tx=0x7fcc4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b808bdfe2bc2f108 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc52ffd640 1 -- 172.21.15.26:0/1488285562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48037070 con 0x7fcc540b3c00 2024-04-25T13:16:41.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc52ffd640 1 -- 172.21.15.26:0/1488285562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48032440 con 0x7fcc540b3c00 2024-04-25T13:16:41.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc52ffd640 1 -- 172.21.15.26:0/1488285562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48032810 con 0x7fcc540b3c00 2024-04-25T13:16:41.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc5a889640 1 -- 172.21.15.26:0/1488285562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 msgr2=0x7fcc540b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc5a889640 1 --2- 172.21.15.26:0/1488285562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540b4f10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcc480097a0 tx=0x7fcc4802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc5a889640 1 -- 172.21.15.26:0/1488285562 shutdown_connections 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc5a889640 1 --2- 172.21.15.26:0/1488285562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540b4f10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.443+0000 7fcc5a889640 1 -- 172.21.15.26:0/1488285562 >> 172.21.15.26:0/1488285562 conn(0x7fcc54074d50 msgr2=0x7fcc54075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.444+0000 7fcc5a889640 1 -- 172.21.15.26:0/1488285562 shutdown_connections 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.444+0000 7fcc5a889640 1 -- 172.21.15.26:0/1488285562 wait complete. 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.445+0000 7fcc5a889640 1 Processor -- start 2024-04-25T13:16:41.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.445+0000 7fcc5a889640 1 -- start start 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.445+0000 7fcc5a889640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc5a889640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc540b5450 0x7fcc541f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc5a889640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc541554e0 0x7fcc541f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc5a889640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcc540b4710 con 0x7fcc540b3c00 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc5a889640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcc540b4430 con 0x7fcc541554e0 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc5a889640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcc540b3580 con 0x7fcc540b5450 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36936/0 (socket says 172.21.15.26:36936) 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 -- 172.21.15.26:0/31678811 learned_addr learned my addr 172.21.15.26:0/31678811 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:41.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc58e26640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc541554e0 0x7fcc541f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc537fe640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc540b5450 0x7fcc541f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 -- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc540b5450 msgr2=0x7fcc541f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc540b5450 0x7fcc541f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 -- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc541554e0 msgr2=0x7fcc541f1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc541554e0 0x7fcc541f1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 -- 172.21.15.26:0/31678811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5415c290 con 0x7fcc540b3c00 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc537fe640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc540b5450 0x7fcc541f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc53fff640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540ca220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c460 tx=0x7fcc4400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc50ff9640 1 -- 172.21.15.26:0/31678811 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44016020 con 0x7fcc540b3c00 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc541f4510 con 0x7fcc540b3c00 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc50ff9640 1 -- 172.21.15.26:0/31678811 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc44012870 con 0x7fcc540b3c00 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc50ff9640 1 -- 172.21.15.26:0/31678811 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44012c60 con 0x7fcc540b3c00 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.446+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc541f4ad0 con 0x7fcc540b3c00 2024-04-25T13:16:41.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.447+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc540cd7c0 con 0x7fcc540b3c00 2024-04-25T13:16:41.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.448+0000 7fcc50ff9640 1 -- 172.21.15.26:0/31678811 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc44019020 con 0x7fcc540b3c00 2024-04-25T13:16:41.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.448+0000 7fcc50ff9640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4006c8f0 0x7fcc4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.448+0000 7fcc50ff9640 1 -- 172.21.15.26:0/31678811 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcc4408bc40 con 0x7fcc540b3c00 2024-04-25T13:16:41.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.448+0000 7fcc537fe640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4006c8f0 0x7fcc4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.449+0000 7fcc537fe640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4006c8f0 0x7fcc4006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc48034000 tx=0x7fcc4802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.452+0000 7fcc50ff9640 1 -- 172.21.15.26:0/31678811 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc540cd7c0 con 0x7fcc540b3c00 2024-04-25T13:16:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.674+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc540b32c0 con 0x7fcc540b3c00 2024-04-25T13:16:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.674+0000 7fcc50ff9640 1 -- 172.21.15.26:0/31678811 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6848 (secure 0 0 0) 0x7fcc540b32c0 con 0x7fcc540b3c00 2024-04-25T13:16:41.675 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:41.676 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:40.685805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4308,"mds_1":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"d","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-04-25T13:16:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 12 2024-04-25T13:16:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4006c8f0 msgr2=0x7fcc4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4006c8f0 0x7fcc4006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc48034000 tx=0x7fcc4802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 msgr2=0x7fcc540ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540ca220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c460 tx=0x7fcc4400c920 comp rx=0 tx=0).stop 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 shutdown_connections 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcc4006c8f0 0x7fcc4006edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc541554e0 0x7fcc541f1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc540b5450 0x7fcc541f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 --2- 172.21.15.26:0/31678811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc540b3c00 0x7fcc540ca220 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.676+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 >> 172.21.15.26:0/31678811 conn(0x7fcc54074d50 msgr2=0x7fcc54153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.677+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 shutdown_connections 2024-04-25T13:16:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.677+0000 7fcc5a889640 1 -- 172.21.15.26:0/31678811 wait complete. 2024-04-25T13:16:41.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:41.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.788+0000 7f1ca08bb640 1 Processor -- start 2024-04-25T13:16:41.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.788+0000 7f1ca08bb640 1 -- start start 2024-04-25T13:16:41.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.789+0000 7f1ca08bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c074d50 0x7f1c9c15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.789+0000 7f1ca08bb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1c9c15f190 0x7f1c9c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.789+0000 7f1ca08bb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c9c0cdcb0 con 0x7f1c9c075130 2024-04-25T13:16:41.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.789+0000 7f1ca08bb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1c9c0c93b0 con 0x7f1c9c15f190 2024-04-25T13:16:41.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.789+0000 7f1ca08bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c0cdf70 con 0x7f1c9c074d50 2024-04-25T13:16:41.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c9a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c074d50 0x7f1c9c15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c99d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1c9c15f190 0x7f1c9c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c99d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1c9c15f190 0x7f1c9c0c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:46470/0 (socket says 172.21.15.26:46470) 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c9a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c074d50 0x7f1c9c15b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:52910/0 (socket says 172.21.15.26:52910) 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c99d9b640 1 -- 172.21.15.26:0/41317483 learned_addr learned my addr 172.21.15.26:0/41317483 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c9ad9d640 1 --1- 172.21.15.26:0/41317483 >> v1:172.21.15.169:6789/0 conn(0x7f1c9c075130 0x7f1c9c075560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:46354/0 (socket says 172.21.15.26:46354) 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c99d9b640 1 -- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c074d50 msgr2=0x7f1c9c15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c99d9b640 1 --2- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c074d50 0x7f1c9c15b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c99d9b640 1 -- 172.21.15.26:0/41317483 >> v1:172.21.15.169:6789/0 conn(0x7f1c9c075130 legacy=0x7f1c9c075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c99d9b640 1 -- 172.21.15.26:0/41317483 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c0ce250 con 0x7f1c9c15f190 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.790+0000 7f1c9a59c640 1 --2- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c074d50 0x7f1c9c15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.791+0000 7f1c99d9b640 1 --2- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 0x7f1c9c0c8e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009870 tx=0x7f1c8402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d776ed50a3d479eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.791+0000 7f1c9959a640 1 -- 172.21.15.26:0/41317483 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84037070 con 0x7f1c9c15f190 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.791+0000 7f1c9959a640 1 -- 172.21.15.26:0/41317483 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8402ae50 con 0x7f1c9c15f190 2024-04-25T13:16:41.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.791+0000 7f1c9959a640 1 -- 172.21.15.26:0/41317483 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84032860 con 0x7f1c9c15f190 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.791+0000 7f1ca08bb640 1 -- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 msgr2=0x7f1c9c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.791+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 0x7f1c9c0c8e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009870 tx=0x7f1c8402a300 comp rx=0 tx=0).stop 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.792+0000 7f1ca08bb640 1 -- 172.21.15.26:0/41317483 shutdown_connections 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.792+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 0x7f1c9c0c8e70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.792+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/41317483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c074d50 0x7f1c9c15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.792+0000 7f1ca08bb640 1 -- 172.21.15.26:0/41317483 >> 172.21.15.26:0/41317483 conn(0x7f1c9c06b920 msgr2=0x7f1c9c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.792+0000 7f1ca08bb640 1 -- 172.21.15.26:0/41317483 shutdown_connections 2024-04-25T13:16:41.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.792+0000 7f1ca08bb640 1 -- 172.21.15.26:0/41317483 wait complete. 2024-04-25T13:16:41.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.793+0000 7f1ca08bb640 1 Processor -- start 2024-04-25T13:16:41.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.793+0000 7f1ca08bb640 1 -- start start 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1ca08bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c9c074d50 0x7f1c9c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1ca08bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c075130 0x7f1c9c1e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1ca08bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 0x7f1c9c1e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1ca08bb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c15ec70 con 0x7f1c9c074d50 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1ca08bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c15e990 con 0x7f1c9c15f190 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1ca08bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c0cd4b0 con 0x7f1c9c075130 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c9c074d50 0x7f1c9c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c9c074d50 0x7f1c9c15c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36938/0 (socket says 172.21.15.26:36938) 2024-04-25T13:16:41.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 -- 172.21.15.26:0/3899815150 learned_addr learned my addr 172.21.15.26:0/3899815150 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9ad9d640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 0x7f1c9c1e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c99d9b640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c075130 0x7f1c9c1e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 -- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c075130 msgr2=0x7f1c9c1e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c075130 0x7f1c9c1e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 -- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 msgr2=0x7f1c9c1e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 0x7f1c9c1e6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 -- 172.21.15.26:0/3899815150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c157ea0 con 0x7f1c9c074d50 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c9a59c640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c9c074d50 0x7f1c9c15c730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400e960 tx=0x7f1c9400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c92ffd640 1 -- 172.21.15.26:0/3899815150 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94017070 con 0x7f1c9c074d50 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.794+0000 7f1c92ffd640 1 -- 172.21.15.26:0/3899815150 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9400c9a0 con 0x7f1c9c074d50 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.795+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c1e5100 con 0x7f1c9c074d50 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.795+0000 7f1c92ffd640 1 -- 172.21.15.26:0/3899815150 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400cd70 con 0x7f1c9c074d50 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.795+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1e56c0 con 0x7f1c9c074d50 2024-04-25T13:16:41.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.795+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c068e40 con 0x7f1c9c074d50 2024-04-25T13:16:41.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.796+0000 7f1c92ffd640 1 -- 172.21.15.26:0/3899815150 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c9401a070 con 0x7f1c9c074d50 2024-04-25T13:16:41.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.796+0000 7f1c92ffd640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c7c06c920 0x7f1c7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.796+0000 7f1c92ffd640 1 -- 172.21.15.26:0/3899815150 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1c9408bfd0 con 0x7f1c9c074d50 2024-04-25T13:16:41.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.797+0000 7f1c99d9b640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c7c06c920 0x7f1c7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.797+0000 7f1c99d9b640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c7c06c920 0x7f1c7c06ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c84034000 tx=0x7f1c8402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.801+0000 7f1c92ffd640 1 -- 172.21.15.26:0/3899815150 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c9c157ea0 con 0x7f1c9c074d50 2024-04-25T13:16:41.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.986+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c9c0c8110 con 0x7f1c9c074d50 2024-04-25T13:16:41.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.987+0000 7f1c92ffd640 1 -- 172.21.15.26:0/3899815150 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f1c94059a60 con 0x7f1c9c074d50 2024-04-25T13:16:41.988 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:41.989 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:41.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c7c06c920 msgr2=0x7f1c7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c7c06c920 0x7f1c7c06ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c84034000 tx=0x7f1c8402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c9c074d50 msgr2=0x7f1c9c15c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c9c074d50 0x7f1c9c15c730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400e960 tx=0x7f1c9400ee20 comp rx=0 tx=0).stop 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 shutdown_connections 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c7c06c920 0x7f1c7c06ede0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c15f190 0x7f1c9c1e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c075130 0x7f1c9c1e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 --2- 172.21.15.26:0/3899815150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c9c074d50 0x7f1c9c15c730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 >> 172.21.15.26:0/3899815150 conn(0x7f1c9c06b920 msgr2=0x7f1c9c142280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 shutdown_connections 2024-04-25T13:16:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:41.989+0000 7f1ca08bb640 1 -- 172.21.15.26:0/3899815150 wait complete. 2024-04-25T13:16:42.001 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T13:16:42.002 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:42.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.102+0000 7f24f807c640 1 Processor -- start 2024-04-25T13:16:42.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.102+0000 7f24f807c640 1 -- start start 2024-04-25T13:16:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f807c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f00b3c00 0x7f24f00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f807c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f24f00b5450 0x7f24f00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f807c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f01558c0 con 0x7f24f01554e0 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f807c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f24f00b4a80 con 0x7f24f00b5450 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f807c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24f00cb8c0 con 0x7f24f00b3c00 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f5e18640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f24f01554e0 0x7f24f015f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58604/0 (socket says 172.21.15.26:58604) 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f5e18640 1 -- 172.21.15.26:0/663804000 learned_addr learned my addr 172.21.15.26:0/663804000 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f5617640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f00b3c00 0x7f24f00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f6619640 1 --2- 172.21.15.26:0/663804000 >> v2:172.21.15.169:3300/0 conn(0x7f24f00b5450 0x7f24f00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514382832 0 0) 0x7f24ec001110 con 0x7f24f01554e0 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24dc003520 con 0x7f24f01554e0 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3092495485 0 0) 0x7f24dc003520 con 0x7f24f01554e0 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f00b3c00 msgr2=0x7f24f00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f00b3c00 0x7f24f00b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 >> v2:172.21.15.169:3300/0 conn(0x7f24f00b5450 msgr2=0x7f24f00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 --2- 172.21.15.26:0/663804000 >> v2:172.21.15.169:3300/0 conn(0x7f24f00b5450 0x7f24f00d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f00cbba0 con 0x7f24f01554e0 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f24ec001840 con 0x7f24f01554e0 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 >> v1:172.21.15.26:6789/0 conn(0x7f24f01554e0 legacy=0x7f24f015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f24f00b4a80 con 0x7f24dc0039b0 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24f00cb8c0 con 0x7f24dc004800 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc00bf00 con 0x7f24dc0051c0 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f6619640 1 --2- 172.21.15.26:0/663804000 >> v2:172.21.15.169:3300/0 conn(0x7f24f00b5450 0x7f24f00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.103+0000 7f24f5617640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f00b3c00 0x7f24f00b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5e18640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f6619640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5e18640 1 -- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24dc0051c0 msgr2=0x7f24dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5617640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5e18640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5e18640 1 -- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24dc004800 msgr2=0x7f24dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5e18640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5e18640 1 -- 172.21.15.26:0/663804000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc003520 con 0x7f24dc0039b0 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5617640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f6619640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.104+0000 7f24f5e18640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c3e0 tx=0x7f24dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a96f5d20f816f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec032020 con 0x7f24dc0039b0 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec005af0 con 0x7f24dc0039b0 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f4e16640 1 -- 172.21.15.26:0/663804000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00c0e0 con 0x7f24dc0039b0 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f807c640 1 -- 172.21.15.26:0/663804000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 msgr2=0x7f24dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f807c640 1 --2- 172.21.15.26:0/663804000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24dc003dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c3e0 tx=0x7f24dc005830 comp rx=0 tx=0).stop 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f6619640 1 -- 172.21.15.26:0/663804000 reap_dead start 2024-04-25T13:16:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f807c640 1 -- 172.21.15.26:0/663804000 shutdown_connections 2024-04-25T13:16:42.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f807c640 1 -- 172.21.15.26:0/663804000 >> 172.21.15.26:0/663804000 conn(0x7f24f0074d50 msgr2=0x7f24f0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f807c640 1 -- 172.21.15.26:0/663804000 shutdown_connections 2024-04-25T13:16:42.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.105+0000 7f24f807c640 1 -- 172.21.15.26:0/663804000 wait complete. 2024-04-25T13:16:42.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.106+0000 7f24f807c640 1 Processor -- start 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.106+0000 7f24f807c640 1 -- start start 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f807c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24f00cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f807c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24f00c3dd0 0x7f24f0150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f807c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f014ece0 0x7f24f014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f807c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f24f00b4710 con 0x7f24dc0039b0 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f807c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24f00b4430 con 0x7f24f00c3dd0 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f807c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24f00b3580 con 0x7f24f014ece0 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f5e18640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24f00cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f5e18640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24f00cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36952/0 (socket says 172.21.15.26:36952) 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f5e18640 1 -- 172.21.15.26:0/1060650640 learned_addr learned my addr 172.21.15.26:0/1060650640 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f6619640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f014ece0 0x7f24f014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.107+0000 7f24f5617640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24f00c3dd0 0x7f24f0150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f5e18640 1 -- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f014ece0 msgr2=0x7f24f014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f5e18640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f014ece0 0x7f24f014f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f5e18640 1 -- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24f00c3dd0 msgr2=0x7f24f0150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f5e18640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24f00c3dd0 0x7f24f0150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f5e18640 1 -- 172.21.15.26:0/1060650640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f00d0840 con 0x7f24dc0039b0 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f5e18640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24f00cf760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24ec02b020 tx=0x7f24ec001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24e67fc640 1 -- 172.21.15.26:0/1060650640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec032030 con 0x7f24dc0039b0 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24e67fc640 1 -- 172.21.15.26:0/1060650640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec007070 con 0x7f24dc0039b0 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f00cffa0 con 0x7f24dc0039b0 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24e67fc640 1 -- 172.21.15.26:0/1060650640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec007420 con 0x7f24dc0039b0 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.108+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f00d0560 con 0x7f24dc0039b0 2024-04-25T13:16:42.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.109+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f0068e40 con 0x7f24dc0039b0 2024-04-25T13:16:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.109+0000 7f24e67fc640 1 -- 172.21.15.26:0/1060650640 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24ec041030 con 0x7f24dc0039b0 2024-04-25T13:16:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.110+0000 7f24e67fc640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f24d406c920 0x7f24d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.110+0000 7f24e67fc640 1 -- 172.21.15.26:0/1060650640 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f24ec0abd90 con 0x7f24dc0039b0 2024-04-25T13:16:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.110+0000 7f24f5617640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f24d406c920 0x7f24d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.111+0000 7f24f5617640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f24d406c920 0x7f24d406ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f24f015be20 tx=0x7f24e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.114+0000 7f24e67fc640 1 -- 172.21.15.26:0/1060650640 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24ec048020 con 0x7f24dc0039b0 2024-04-25T13:16:42.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.298+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24f00ca1a0 con 0x7f24d406c920 2024-04-25T13:16:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.307+0000 7f24e67fc640 1 -- 172.21.15.26:0/1060650640 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f24f00ca1a0 con 0x7f24d406c920 2024-04-25T13:16:42.312 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:16:42.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f24d406c920 msgr2=0x7f24d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f24d406c920 0x7f24d406ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f24f015be20 tx=0x7f24e0008040 comp rx=0 tx=0).stop 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 msgr2=0x7f24f00cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24f00cf760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24ec02b020 tx=0x7f24ec001c10 comp rx=0 tx=0).stop 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 shutdown_connections 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f24d406c920 0x7f24d406ede0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24f014ece0 0x7f24f014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24f00c3dd0 0x7f24f0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 --2- 172.21.15.26:0/1060650640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24dc0039b0 0x7f24f00cf760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 >> 172.21.15.26:0/1060650640 conn(0x7f24f0074d50 msgr2=0x7f24f00ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 shutdown_connections 2024-04-25T13:16:42.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.310+0000 7f24f807c640 1 -- 172.21.15.26:0/1060650640 wait complete. 2024-04-25T13:16:42.322 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T13:16:41.170725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1989824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002988"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353534+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:16:16.353534+0000","last_peered":"2024-04-25T13:16:16.353534+0000","last_clean":"2024-04-25T13:16:16.353534+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:16:16.353534+0000","last_undegraded":"2024-04-25T13:16:16.353534+0000","last_fullsized":"2024-04-25T13:16:16.353534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:27.622324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246107+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:16.246107+0000","last_peered":"2024-04-25T13:16:16.246107+0000","last_clean":"2024-04-25T13:16:16.246107+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:16.246107+0000","last_undegraded":"2024-04-25T13:16:16.246107+0000","last_fullsized":"2024-04-25T13:16:16.246107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245536+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:16.245536+0000","last_peered":"2024-04-25T13:16:16.245536+0000","last_clean":"2024-04-25T13:16:16.245536+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:16.245536+0000","last_undegraded":"2024-04-25T13:16:16.245536+0000","last_fullsized":"2024-04-25T13:16:16.245536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246261+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:16.246261+0000","last_peered":"2024-04-25T13:16:16.246261+0000","last_clean":"2024-04-25T13:16:16.246261+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:16.246261+0000","last_undegraded":"2024-04-25T13:16:16.246261+0000","last_fullsized":"2024-04-25T13:16:16.246261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353395+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:16.353395+0000","last_peered":"2024-04-25T13:16:16.353395+0000","last_clean":"2024-04-25T13:16:16.353395+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:16.353395+0000","last_undegraded":"2024-04-25T13:16:16.353395+0000","last_fullsized":"2024-04-25T13:16:16.353395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:07.806920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241491+0000","last_change":"2024-04-25T13:16:14.257938+0000","last_active":"2024-04-25T13:16:15.241491+0000","last_peered":"2024-04-25T13:16:15.241491+0000","last_clean":"2024-04-25T13:16:15.241491+0000","last_became_active":"2024-04-25T13:16:14.257583+0000","last_became_peered":"2024-04-25T13:16:14.257583+0000","last_unstale":"2024-04-25T13:16:15.241491+0000","last_undegraded":"2024-04-25T13:16:15.241491+0000","last_fullsized":"2024-04-25T13:16:15.241491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:00.046474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239900+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:16:15.239900+0000","last_peered":"2024-04-25T13:16:15.239900+0000","last_clean":"2024-04-25T13:16:15.239900+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:16:15.239900+0000","last_undegraded":"2024-04-25T13:16:15.239900+0000","last_fullsized":"2024-04-25T13:16:15.239900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353492+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:16.353492+0000","last_peered":"2024-04-25T13:16:16.353492+0000","last_clean":"2024-04-25T13:16:16.353492+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:16.353492+0000","last_undegraded":"2024-04-25T13:16:16.353492+0000","last_fullsized":"2024-04-25T13:16:16.353492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242398+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:15.242398+0000","last_peered":"2024-04-25T13:16:15.242398+0000","last_clean":"2024-04-25T13:16:15.242398+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:15.242398+0000","last_undegraded":"2024-04-25T13:16:15.242398+0000","last_fullsized":"2024-04-25T13:16:15.242398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239287+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:16:15.239287+0000","last_peered":"2024-04-25T13:16:15.239287+0000","last_clean":"2024-04-25T13:16:15.239287+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:16:15.239287+0000","last_undegraded":"2024-04-25T13:16:15.239287+0000","last_fullsized":"2024-04-25T13:16:15.239287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353813+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:16.353813+0000","last_peered":"2024-04-25T13:16:16.353813+0000","last_clean":"2024-04-25T13:16:16.353813+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:16.353813+0000","last_undegraded":"2024-04-25T13:16:16.353813+0000","last_fullsized":"2024-04-25T13:16:16.353813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241607+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:15.241607+0000","last_peered":"2024-04-25T13:16:15.241607+0000","last_clean":"2024-04-25T13:16:15.241607+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:15.241607+0000","last_undegraded":"2024-04-25T13:16:15.241607+0000","last_fullsized":"2024-04-25T13:16:15.241607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353968+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:16.353968+0000","last_peered":"2024-04-25T13:16:16.353968+0000","last_clean":"2024-04-25T13:16:16.353968+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:16.353968+0000","last_undegraded":"2024-04-25T13:16:16.353968+0000","last_fullsized":"2024-04-25T13:16:16.353968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239547+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:15.239547+0000","last_peered":"2024-04-25T13:16:15.239547+0000","last_clean":"2024-04-25T13:16:15.239547+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:15.239547+0000","last_undegraded":"2024-04-25T13:16:15.239547+0000","last_fullsized":"2024-04-25T13:16:15.239547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242365+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:15.242365+0000","last_peered":"2024-04-25T13:16:15.242365+0000","last_clean":"2024-04-25T13:16:15.242365+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:15.242365+0000","last_undegraded":"2024-04-25T13:16:15.242365+0000","last_fullsized":"2024-04-25T13:16:15.242365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245954+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:16.245954+0000","last_peered":"2024-04-25T13:16:16.245954+0000","last_clean":"2024-04-25T13:16:16.245954+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:16.245954+0000","last_undegraded":"2024-04-25T13:16:16.245954+0000","last_fullsized":"2024-04-25T13:16:16.245954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353731+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:16.353731+0000","last_peered":"2024-04-25T13:16:16.353731+0000","last_clean":"2024-04-25T13:16:16.353731+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:16.353731+0000","last_undegraded":"2024-04-25T13:16:16.353731+0000","last_fullsized":"2024-04-25T13:16:16.353731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241972+0000","last_change":"2024-04-25T13:16:14.261022+0000","last_active":"2024-04-25T13:16:15.241972+0000","last_peered":"2024-04-25T13:16:15.241972+0000","last_clean":"2024-04-25T13:16:15.241972+0000","last_became_active":"2024-04-25T13:16:14.260540+0000","last_became_peered":"2024-04-25T13:16:14.260540+0000","last_unstale":"2024-04-25T13:16:15.241972+0000","last_undegraded":"2024-04-25T13:16:15.241972+0000","last_fullsized":"2024-04-25T13:16:15.241972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:17.727873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245714+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:16.245714+0000","last_peered":"2024-04-25T13:16:16.245714+0000","last_clean":"2024-04-25T13:16:16.245714+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:16.245714+0000","last_undegraded":"2024-04-25T13:16:16.245714+0000","last_fullsized":"2024-04-25T13:16:16.245714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353398+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:16:16.353398+0000","last_peered":"2024-04-25T13:16:16.353398+0000","last_clean":"2024-04-25T13:16:16.353398+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:16:16.353398+0000","last_undegraded":"2024-04-25T13:16:16.353398+0000","last_fullsized":"2024-04-25T13:16:16.353398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354184+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:16.354184+0000","last_peered":"2024-04-25T13:16:16.354184+0000","last_clean":"2024-04-25T13:16:16.354184+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:16.354184+0000","last_undegraded":"2024-04-25T13:16:16.354184+0000","last_fullsized":"2024-04-25T13:16:16.354184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241824+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:15.241824+0000","last_peered":"2024-04-25T13:16:15.241824+0000","last_clean":"2024-04-25T13:16:15.241824+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:15.241824+0000","last_undegraded":"2024-04-25T13:16:15.241824+0000","last_fullsized":"2024-04-25T13:16:15.241824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238962+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:15.238962+0000","last_peered":"2024-04-25T13:16:15.238962+0000","last_clean":"2024-04-25T13:16:15.238962+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:15.238962+0000","last_undegraded":"2024-04-25T13:16:15.238962+0000","last_fullsized":"2024-04-25T13:16:15.238962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242094+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:15.242094+0000","last_peered":"2024-04-25T13:16:15.242094+0000","last_clean":"2024-04-25T13:16:15.242094+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:15.242094+0000","last_undegraded":"2024-04-25T13:16:15.242094+0000","last_fullsized":"2024-04-25T13:16:15.242094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354392+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:16.354392+0000","last_peered":"2024-04-25T13:16:16.354392+0000","last_clean":"2024-04-25T13:16:16.354392+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:16.354392+0000","last_undegraded":"2024-04-25T13:16:16.354392+0000","last_fullsized":"2024-04-25T13:16:16.354392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:07.387828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354625+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:16:16.354625+0000","last_peered":"2024-04-25T13:16:16.354625+0000","last_clean":"2024-04-25T13:16:16.354625+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:16:16.354625+0000","last_undegraded":"2024-04-25T13:16:16.354625+0000","last_fullsized":"2024-04-25T13:16:16.354625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241492+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:15.241492+0000","last_peered":"2024-04-25T13:16:15.241492+0000","last_clean":"2024-04-25T13:16:15.241492+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:15.241492+0000","last_undegraded":"2024-04-25T13:16:15.241492+0000","last_fullsized":"2024-04-25T13:16:15.241492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246222+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:16.246222+0000","last_peered":"2024-04-25T13:16:16.246222+0000","last_clean":"2024-04-25T13:16:16.246222+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:16.246222+0000","last_undegraded":"2024-04-25T13:16:16.246222+0000","last_fullsized":"2024-04-25T13:16:16.246222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353936+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:16.353936+0000","last_peered":"2024-04-25T13:16:16.353936+0000","last_clean":"2024-04-25T13:16:16.353936+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:16.353936+0000","last_undegraded":"2024-04-25T13:16:16.353936+0000","last_fullsized":"2024-04-25T13:16:16.353936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245445+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:16.245445+0000","last_peered":"2024-04-25T13:16:16.245445+0000","last_clean":"2024-04-25T13:16:16.245445+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:16.245445+0000","last_undegraded":"2024-04-25T13:16:16.245445+0000","last_fullsized":"2024-04-25T13:16:16.245445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354537+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:16.354537+0000","last_peered":"2024-04-25T13:16:16.354537+0000","last_clean":"2024-04-25T13:16:16.354537+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:16.354537+0000","last_undegraded":"2024-04-25T13:16:16.354537+0000","last_fullsized":"2024-04-25T13:16:16.354537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239990+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:15.239990+0000","last_peered":"2024-04-25T13:16:15.239990+0000","last_clean":"2024-04-25T13:16:15.239990+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:15.239990+0000","last_undegraded":"2024-04-25T13:16:15.239990+0000","last_fullsized":"2024-04-25T13:16:15.239990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:52.881166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354421+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:16.354421+0000","last_peered":"2024-04-25T13:16:16.354421+0000","last_clean":"2024-04-25T13:16:16.354421+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354421+0000","last_undegraded":"2024-04-25T13:16:16.354421+0000","last_fullsized":"2024-04-25T13:16:16.354421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354591+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:16.354591+0000","last_peered":"2024-04-25T13:16:16.354591+0000","last_clean":"2024-04-25T13:16:16.354591+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:16.354591+0000","last_undegraded":"2024-04-25T13:16:16.354591+0000","last_fullsized":"2024-04-25T13:16:16.354591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353448+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:16.353448+0000","last_peered":"2024-04-25T13:16:16.353448+0000","last_clean":"2024-04-25T13:16:16.353448+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:16.353448+0000","last_undegraded":"2024-04-25T13:16:16.353448+0000","last_fullsized":"2024-04-25T13:16:16.353448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242591+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:15.242591+0000","last_peered":"2024-04-25T13:16:15.242591+0000","last_clean":"2024-04-25T13:16:15.242591+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:15.242591+0000","last_undegraded":"2024-04-25T13:16:15.242591+0000","last_fullsized":"2024-04-25T13:16:15.242591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354376+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:16:16.354376+0000","last_peered":"2024-04-25T13:16:16.354376+0000","last_clean":"2024-04-25T13:16:16.354376+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:16:16.354376+0000","last_undegraded":"2024-04-25T13:16:16.354376+0000","last_fullsized":"2024-04-25T13:16:16.354376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354448+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:16.354448+0000","last_peered":"2024-04-25T13:16:16.354448+0000","last_clean":"2024-04-25T13:16:16.354448+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:16.354448+0000","last_undegraded":"2024-04-25T13:16:16.354448+0000","last_fullsized":"2024-04-25T13:16:16.354448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354505+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:16.354505+0000","last_peered":"2024-04-25T13:16:16.354505+0000","last_clean":"2024-04-25T13:16:16.354505+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:16.354505+0000","last_undegraded":"2024-04-25T13:16:16.354505+0000","last_fullsized":"2024-04-25T13:16:16.354505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238775+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:16:15.238775+0000","last_peered":"2024-04-25T13:16:15.238775+0000","last_clean":"2024-04-25T13:16:15.238775+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:16:15.238775+0000","last_undegraded":"2024-04-25T13:16:15.238775+0000","last_fullsized":"2024-04-25T13:16:15.238775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354340+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:16.354340+0000","last_peered":"2024-04-25T13:16:16.354340+0000","last_clean":"2024-04-25T13:16:16.354340+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:16.354340+0000","last_undegraded":"2024-04-25T13:16:16.354340+0000","last_fullsized":"2024-04-25T13:16:16.354340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.352967+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:16.352967+0000","last_peered":"2024-04-25T13:16:16.352967+0000","last_clean":"2024-04-25T13:16:16.352967+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:16.352967+0000","last_undegraded":"2024-04-25T13:16:16.352967+0000","last_fullsized":"2024-04-25T13:16:16.352967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:14.197407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239182+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:15.239182+0000","last_peered":"2024-04-25T13:16:15.239182+0000","last_clean":"2024-04-25T13:16:15.239182+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:15.239182+0000","last_undegraded":"2024-04-25T13:16:15.239182+0000","last_fullsized":"2024-04-25T13:16:15.239182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354197+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:16.354197+0000","last_peered":"2024-04-25T13:16:16.354197+0000","last_clean":"2024-04-25T13:16:16.354197+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:16.354197+0000","last_undegraded":"2024-04-25T13:16:16.354197+0000","last_fullsized":"2024-04-25T13:16:16.354197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:00.494861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245825+0000","last_change":"2024-04-25T13:16:10.234248+0000","last_active":"2024-04-25T13:16:16.245825+0000","last_peered":"2024-04-25T13:16:16.245825+0000","last_clean":"2024-04-25T13:16:16.245825+0000","last_became_active":"2024-04-25T13:16:10.233963+0000","last_became_peered":"2024-04-25T13:16:10.233963+0000","last_unstale":"2024-04-25T13:16:16.245825+0000","last_undegraded":"2024-04-25T13:16:16.245825+0000","last_fullsized":"2024-04-25T13:16:16.245825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:04.216005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353488+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:16.353488+0000","last_peered":"2024-04-25T13:16:16.353488+0000","last_clean":"2024-04-25T13:16:16.353488+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:16.353488+0000","last_undegraded":"2024-04-25T13:16:16.353488+0000","last_fullsized":"2024-04-25T13:16:16.353488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239179+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:15.239179+0000","last_peered":"2024-04-25T13:16:15.239179+0000","last_clean":"2024-04-25T13:16:15.239179+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:15.239179+0000","last_undegraded":"2024-04-25T13:16:15.239179+0000","last_fullsized":"2024-04-25T13:16:15.239179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354218+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:16.354218+0000","last_peered":"2024-04-25T13:16:16.354218+0000","last_clean":"2024-04-25T13:16:16.354218+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:16.354218+0000","last_undegraded":"2024-04-25T13:16:16.354218+0000","last_fullsized":"2024-04-25T13:16:16.354218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239814+0000","last_change":"2024-04-25T13:16:10.234837+0000","last_active":"2024-04-25T13:16:15.239814+0000","last_peered":"2024-04-25T13:16:15.239814+0000","last_clean":"2024-04-25T13:16:15.239814+0000","last_became_active":"2024-04-25T13:16:10.234555+0000","last_became_peered":"2024-04-25T13:16:10.234555+0000","last_unstale":"2024-04-25T13:16:15.239814+0000","last_undegraded":"2024-04-25T13:16:15.239814+0000","last_fullsized":"2024-04-25T13:16:15.239814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:51.058397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238900+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:16:15.238900+0000","last_peered":"2024-04-25T13:16:15.238900+0000","last_clean":"2024-04-25T13:16:15.238900+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:16:15.238900+0000","last_undegraded":"2024-04-25T13:16:15.238900+0000","last_fullsized":"2024-04-25T13:16:15.238900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353858+0000","last_change":"2024-04-25T13:16:14.252829+0000","last_active":"2024-04-25T13:16:16.353858+0000","last_peered":"2024-04-25T13:16:16.353858+0000","last_clean":"2024-04-25T13:16:16.353858+0000","last_became_active":"2024-04-25T13:16:14.252177+0000","last_became_peered":"2024-04-25T13:16:14.252177+0000","last_unstale":"2024-04-25T13:16:16.353858+0000","last_undegraded":"2024-04-25T13:16:16.353858+0000","last_fullsized":"2024-04-25T13:16:16.353858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:36.730765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353599+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:16.353599+0000","last_peered":"2024-04-25T13:16:16.353599+0000","last_clean":"2024-04-25T13:16:16.353599+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:16.353599+0000","last_undegraded":"2024-04-25T13:16:16.353599+0000","last_fullsized":"2024-04-25T13:16:16.353599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354155+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:16.354155+0000","last_peered":"2024-04-25T13:16:16.354155+0000","last_clean":"2024-04-25T13:16:16.354155+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:16.354155+0000","last_undegraded":"2024-04-25T13:16:16.354155+0000","last_fullsized":"2024-04-25T13:16:16.354155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353335+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:16.353335+0000","last_peered":"2024-04-25T13:16:16.353335+0000","last_clean":"2024-04-25T13:16:16.353335+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:16.353335+0000","last_undegraded":"2024-04-25T13:16:16.353335+0000","last_fullsized":"2024-04-25T13:16:16.353335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:35.815826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239702+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:15.239702+0000","last_peered":"2024-04-25T13:16:15.239702+0000","last_clean":"2024-04-25T13:16:15.239702+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:15.239702+0000","last_undegraded":"2024-04-25T13:16:15.239702+0000","last_fullsized":"2024-04-25T13:16:15.239702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238960+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:16:15.238960+0000","last_peered":"2024-04-25T13:16:15.238960+0000","last_clean":"2024-04-25T13:16:15.238960+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:16:15.238960+0000","last_undegraded":"2024-04-25T13:16:15.238960+0000","last_fullsized":"2024-04-25T13:16:15.238960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353010+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:16.353010+0000","last_peered":"2024-04-25T13:16:16.353010+0000","last_clean":"2024-04-25T13:16:16.353010+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:16.353010+0000","last_undegraded":"2024-04-25T13:16:16.353010+0000","last_fullsized":"2024-04-25T13:16:16.353010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239534+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:15.239534+0000","last_peered":"2024-04-25T13:16:15.239534+0000","last_clean":"2024-04-25T13:16:15.239534+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:15.239534+0000","last_undegraded":"2024-04-25T13:16:15.239534+0000","last_fullsized":"2024-04-25T13:16:15.239534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242078+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:15.242078+0000","last_peered":"2024-04-25T13:16:15.242078+0000","last_clean":"2024-04-25T13:16:15.242078+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:15.242078+0000","last_undegraded":"2024-04-25T13:16:15.242078+0000","last_fullsized":"2024-04-25T13:16:15.242078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241484+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:15.241484+0000","last_peered":"2024-04-25T13:16:15.241484+0000","last_clean":"2024-04-25T13:16:15.241484+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:15.241484+0000","last_undegraded":"2024-04-25T13:16:15.241484+0000","last_fullsized":"2024-04-25T13:16:15.241484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239108+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:15.239108+0000","last_peered":"2024-04-25T13:16:15.239108+0000","last_clean":"2024-04-25T13:16:15.239108+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:15.239108+0000","last_undegraded":"2024-04-25T13:16:15.239108+0000","last_fullsized":"2024-04-25T13:16:15.239108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238426+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:15.238426+0000","last_peered":"2024-04-25T13:16:15.238426+0000","last_clean":"2024-04-25T13:16:15.238426+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:15.238426+0000","last_undegraded":"2024-04-25T13:16:15.238426+0000","last_fullsized":"2024-04-25T13:16:15.238426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354056+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:16.354056+0000","last_peered":"2024-04-25T13:16:16.354056+0000","last_clean":"2024-04-25T13:16:16.354056+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:16.354056+0000","last_undegraded":"2024-04-25T13:16:16.354056+0000","last_fullsized":"2024-04-25T13:16:16.354056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:15.310573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353676+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:16.353676+0000","last_peered":"2024-04-25T13:16:16.353676+0000","last_clean":"2024-04-25T13:16:16.353676+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:16.353676+0000","last_undegraded":"2024-04-25T13:16:16.353676+0000","last_fullsized":"2024-04-25T13:16:16.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354116+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:16:16.354116+0000","last_peered":"2024-04-25T13:16:16.354116+0000","last_clean":"2024-04-25T13:16:16.354116+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:16:16.354116+0000","last_undegraded":"2024-04-25T13:16:16.354116+0000","last_fullsized":"2024-04-25T13:16:16.354116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246099+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:16.246099+0000","last_peered":"2024-04-25T13:16:16.246099+0000","last_clean":"2024-04-25T13:16:16.246099+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:16.246099+0000","last_undegraded":"2024-04-25T13:16:16.246099+0000","last_fullsized":"2024-04-25T13:16:16.246099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239499+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:15.239499+0000","last_peered":"2024-04-25T13:16:15.239499+0000","last_clean":"2024-04-25T13:16:15.239499+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:15.239499+0000","last_undegraded":"2024-04-25T13:16:15.239499+0000","last_fullsized":"2024-04-25T13:16:15.239499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353468+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:16.353468+0000","last_peered":"2024-04-25T13:16:16.353468+0000","last_clean":"2024-04-25T13:16:16.353468+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:16.353468+0000","last_undegraded":"2024-04-25T13:16:16.353468+0000","last_fullsized":"2024-04-25T13:16:16.353468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246276+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:16.246276+0000","last_peered":"2024-04-25T13:16:16.246276+0000","last_clean":"2024-04-25T13:16:16.246276+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:16.246276+0000","last_undegraded":"2024-04-25T13:16:16.246276+0000","last_fullsized":"2024-04-25T13:16:16.246276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353735+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:16.353735+0000","last_peered":"2024-04-25T13:16:16.353735+0000","last_clean":"2024-04-25T13:16:16.353735+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:16.353735+0000","last_undegraded":"2024-04-25T13:16:16.353735+0000","last_fullsized":"2024-04-25T13:16:16.353735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:24.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353518+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:16:16.353518+0000","last_peered":"2024-04-25T13:16:16.353518+0000","last_clean":"2024-04-25T13:16:16.353518+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:16:16.353518+0000","last_undegraded":"2024-04-25T13:16:16.353518+0000","last_fullsized":"2024-04-25T13:16:16.353518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:49.859293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353792+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:16.353792+0000","last_peered":"2024-04-25T13:16:16.353792+0000","last_clean":"2024-04-25T13:16:16.353792+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:16.353792+0000","last_undegraded":"2024-04-25T13:16:16.353792+0000","last_fullsized":"2024-04-25T13:16:16.353792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239616+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:15.239616+0000","last_peered":"2024-04-25T13:16:15.239616+0000","last_clean":"2024-04-25T13:16:15.239616+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:15.239616+0000","last_undegraded":"2024-04-25T13:16:15.239616+0000","last_fullsized":"2024-04-25T13:16:15.239616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:30.515181+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:16:30.515181+0000","last_peered":"2024-04-25T13:16:30.515181+0000","last_clean":"2024-04-25T13:16:30.515181+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:16:30.515181+0000","last_undegraded":"2024-04-25T13:16:30.515181+0000","last_fullsized":"2024-04-25T13:16:30.515181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353615+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:16.353615+0000","last_peered":"2024-04-25T13:16:16.353615+0000","last_clean":"2024-04-25T13:16:16.353615+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:16.353615+0000","last_undegraded":"2024-04-25T13:16:16.353615+0000","last_fullsized":"2024-04-25T13:16:16.353615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242098+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:15.242098+0000","last_peered":"2024-04-25T13:16:15.242098+0000","last_clean":"2024-04-25T13:16:15.242098+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:15.242098+0000","last_undegraded":"2024-04-25T13:16:15.242098+0000","last_fullsized":"2024-04-25T13:16:15.242098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354055+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:16.354055+0000","last_peered":"2024-04-25T13:16:16.354055+0000","last_clean":"2024-04-25T13:16:16.354055+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:16.354055+0000","last_undegraded":"2024-04-25T13:16:16.354055+0000","last_fullsized":"2024-04-25T13:16:16.354055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242563+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:15.242563+0000","last_peered":"2024-04-25T13:16:15.242563+0000","last_clean":"2024-04-25T13:16:15.242563+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:15.242563+0000","last_undegraded":"2024-04-25T13:16:15.242563+0000","last_fullsized":"2024-04-25T13:16:15.242563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353633+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:16.353633+0000","last_peered":"2024-04-25T13:16:16.353633+0000","last_clean":"2024-04-25T13:16:16.353633+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:16.353633+0000","last_undegraded":"2024-04-25T13:16:16.353633+0000","last_fullsized":"2024-04-25T13:16:16.353633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:59.519018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353823+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:16:16.353823+0000","last_peered":"2024-04-25T13:16:16.353823+0000","last_clean":"2024-04-25T13:16:16.353823+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:16:16.353823+0000","last_undegraded":"2024-04-25T13:16:16.353823+0000","last_fullsized":"2024-04-25T13:16:16.353823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245632+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:16.245632+0000","last_peered":"2024-04-25T13:16:16.245632+0000","last_clean":"2024-04-25T13:16:16.245632+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:16.245632+0000","last_undegraded":"2024-04-25T13:16:16.245632+0000","last_fullsized":"2024-04-25T13:16:16.245632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353701+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:16.353701+0000","last_peered":"2024-04-25T13:16:16.353701+0000","last_clean":"2024-04-25T13:16:16.353701+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:16.353701+0000","last_undegraded":"2024-04-25T13:16:16.353701+0000","last_fullsized":"2024-04-25T13:16:16.353701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354545+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:16:16.354545+0000","last_peered":"2024-04-25T13:16:16.354545+0000","last_clean":"2024-04-25T13:16:16.354545+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:16:16.354545+0000","last_undegraded":"2024-04-25T13:16:16.354545+0000","last_fullsized":"2024-04-25T13:16:16.354545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245573+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:16.245573+0000","last_peered":"2024-04-25T13:16:16.245573+0000","last_clean":"2024-04-25T13:16:16.245573+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:16.245573+0000","last_undegraded":"2024-04-25T13:16:16.245573+0000","last_fullsized":"2024-04-25T13:16:16.245573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353911+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:16.353911+0000","last_peered":"2024-04-25T13:16:16.353911+0000","last_clean":"2024-04-25T13:16:16.353911+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:16.353911+0000","last_undegraded":"2024-04-25T13:16:16.353911+0000","last_fullsized":"2024-04-25T13:16:16.353911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.475502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353851+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:16.353851+0000","last_peered":"2024-04-25T13:16:16.353851+0000","last_clean":"2024-04-25T13:16:16.353851+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:16.353851+0000","last_undegraded":"2024-04-25T13:16:16.353851+0000","last_fullsized":"2024-04-25T13:16:16.353851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353153+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:16.353153+0000","last_peered":"2024-04-25T13:16:16.353153+0000","last_clean":"2024-04-25T13:16:16.353153+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:16.353153+0000","last_undegraded":"2024-04-25T13:16:16.353153+0000","last_fullsized":"2024-04-25T13:16:16.353153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354404+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:16.354404+0000","last_peered":"2024-04-25T13:16:16.354404+0000","last_clean":"2024-04-25T13:16:16.354404+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:16.354404+0000","last_undegraded":"2024-04-25T13:16:16.354404+0000","last_fullsized":"2024-04-25T13:16:16.354404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245598+0000","last_change":"2024-04-25T13:16:10.230726+0000","last_active":"2024-04-25T13:16:16.245598+0000","last_peered":"2024-04-25T13:16:16.245598+0000","last_clean":"2024-04-25T13:16:16.245598+0000","last_became_active":"2024-04-25T13:16:10.228712+0000","last_became_peered":"2024-04-25T13:16:10.228712+0000","last_unstale":"2024-04-25T13:16:16.245598+0000","last_undegraded":"2024-04-25T13:16:16.245598+0000","last_fullsized":"2024-04-25T13:16:16.245598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:43.499305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245839+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:16.245839+0000","last_peered":"2024-04-25T13:16:16.245839+0000","last_clean":"2024-04-25T13:16:16.245839+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:16.245839+0000","last_undegraded":"2024-04-25T13:16:16.245839+0000","last_fullsized":"2024-04-25T13:16:16.245839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354063+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:16.354063+0000","last_peered":"2024-04-25T13:16:16.354063+0000","last_clean":"2024-04-25T13:16:16.354063+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:16.354063+0000","last_undegraded":"2024-04-25T13:16:16.354063+0000","last_fullsized":"2024-04-25T13:16:16.354063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353420+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:16.353420+0000","last_peered":"2024-04-25T13:16:16.353420+0000","last_clean":"2024-04-25T13:16:16.353420+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:16.353420+0000","last_undegraded":"2024-04-25T13:16:16.353420+0000","last_fullsized":"2024-04-25T13:16:16.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238725+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:15.238725+0000","last_peered":"2024-04-25T13:16:15.238725+0000","last_clean":"2024-04-25T13:16:15.238725+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:15.238725+0000","last_undegraded":"2024-04-25T13:16:15.238725+0000","last_fullsized":"2024-04-25T13:16:15.238725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246106+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:16:16.246106+0000","last_peered":"2024-04-25T13:16:16.246106+0000","last_clean":"2024-04-25T13:16:16.246106+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:16:16.246106+0000","last_undegraded":"2024-04-25T13:16:16.246106+0000","last_fullsized":"2024-04-25T13:16:16.246106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241834+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:15.241834+0000","last_peered":"2024-04-25T13:16:15.241834+0000","last_clean":"2024-04-25T13:16:15.241834+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:15.241834+0000","last_undegraded":"2024-04-25T13:16:15.241834+0000","last_fullsized":"2024-04-25T13:16:15.241834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246117+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:16.246117+0000","last_peered":"2024-04-25T13:16:16.246117+0000","last_clean":"2024-04-25T13:16:16.246117+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:16.246117+0000","last_undegraded":"2024-04-25T13:16:16.246117+0000","last_fullsized":"2024-04-25T13:16:16.246117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353553+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:16.353553+0000","last_peered":"2024-04-25T13:16:16.353553+0000","last_clean":"2024-04-25T13:16:16.353553+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:16.353553+0000","last_undegraded":"2024-04-25T13:16:16.353553+0000","last_fullsized":"2024-04-25T13:16:16.353553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238557+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:15.238557+0000","last_peered":"2024-04-25T13:16:15.238557+0000","last_clean":"2024-04-25T13:16:15.238557+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:15.238557+0000","last_undegraded":"2024-04-25T13:16:15.238557+0000","last_fullsized":"2024-04-25T13:16:15.238557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353362+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:16.353362+0000","last_peered":"2024-04-25T13:16:16.353362+0000","last_clean":"2024-04-25T13:16:16.353362+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:16.353362+0000","last_undegraded":"2024-04-25T13:16:16.353362+0000","last_fullsized":"2024-04-25T13:16:16.353362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353399+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:16.353399+0000","last_peered":"2024-04-25T13:16:16.353399+0000","last_clean":"2024-04-25T13:16:16.353399+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:16.353399+0000","last_undegraded":"2024-04-25T13:16:16.353399+0000","last_fullsized":"2024-04-25T13:16:16.353399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:23.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246373+0000","last_change":"2024-04-25T13:16:10.236483+0000","last_active":"2024-04-25T13:16:16.246373+0000","last_peered":"2024-04-25T13:16:16.246373+0000","last_clean":"2024-04-25T13:16:16.246373+0000","last_became_active":"2024-04-25T13:16:10.236179+0000","last_became_peered":"2024-04-25T13:16:10.236179+0000","last_unstale":"2024-04-25T13:16:16.246373+0000","last_undegraded":"2024-04-25T13:16:16.246373+0000","last_fullsized":"2024-04-25T13:16:16.246373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:23.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354239+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:16.354239+0000","last_peered":"2024-04-25T13:16:16.354239+0000","last_clean":"2024-04-25T13:16:16.354239+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:16.354239+0000","last_undegraded":"2024-04-25T13:16:16.354239+0000","last_fullsized":"2024-04-25T13:16:16.354239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354433+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:16.354433+0000","last_peered":"2024-04-25T13:16:16.354433+0000","last_clean":"2024-04-25T13:16:16.354433+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:16.354433+0000","last_undegraded":"2024-04-25T13:16:16.354433+0000","last_fullsized":"2024-04-25T13:16:16.354433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246083+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:16.246083+0000","last_peered":"2024-04-25T13:16:16.246083+0000","last_clean":"2024-04-25T13:16:16.246083+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:16.246083+0000","last_undegraded":"2024-04-25T13:16:16.246083+0000","last_fullsized":"2024-04-25T13:16:16.246083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353298+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:16.353298+0000","last_peered":"2024-04-25T13:16:16.353298+0000","last_clean":"2024-04-25T13:16:16.353298+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:16.353298+0000","last_undegraded":"2024-04-25T13:16:16.353298+0000","last_fullsized":"2024-04-25T13:16:16.353298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245689+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:16.245689+0000","last_peered":"2024-04-25T13:16:16.245689+0000","last_clean":"2024-04-25T13:16:16.245689+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:16.245689+0000","last_undegraded":"2024-04-25T13:16:16.245689+0000","last_fullsized":"2024-04-25T13:16:16.245689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353453+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:16.353453+0000","last_peered":"2024-04-25T13:16:16.353453+0000","last_clean":"2024-04-25T13:16:16.353453+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:16.353453+0000","last_undegraded":"2024-04-25T13:16:16.353453+0000","last_fullsized":"2024-04-25T13:16:16.353453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353184+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:16.353184+0000","last_peered":"2024-04-25T13:16:16.353184+0000","last_clean":"2024-04-25T13:16:16.353184+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:16.353184+0000","last_undegraded":"2024-04-25T13:16:16.353184+0000","last_fullsized":"2024-04-25T13:16:16.353184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:52.980650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354190+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:16.354190+0000","last_peered":"2024-04-25T13:16:16.354190+0000","last_clean":"2024-04-25T13:16:16.354190+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:16.354190+0000","last_undegraded":"2024-04-25T13:16:16.354190+0000","last_fullsized":"2024-04-25T13:16:16.354190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239903+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:15.239903+0000","last_peered":"2024-04-25T13:16:15.239903+0000","last_clean":"2024-04-25T13:16:15.239903+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:15.239903+0000","last_undegraded":"2024-04-25T13:16:15.239903+0000","last_fullsized":"2024-04-25T13:16:15.239903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238907+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:15.238907+0000","last_peered":"2024-04-25T13:16:15.238907+0000","last_clean":"2024-04-25T13:16:15.238907+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:15.238907+0000","last_undegraded":"2024-04-25T13:16:15.238907+0000","last_fullsized":"2024-04-25T13:16:15.238907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354124+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:16.354124+0000","last_peered":"2024-04-25T13:16:16.354124+0000","last_clean":"2024-04-25T13:16:16.354124+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:16.354124+0000","last_undegraded":"2024-04-25T13:16:16.354124+0000","last_fullsized":"2024-04-25T13:16:16.354124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353029+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:16.353029+0000","last_peered":"2024-04-25T13:16:16.353029+0000","last_clean":"2024-04-25T13:16:16.353029+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:16.353029+0000","last_undegraded":"2024-04-25T13:16:16.353029+0000","last_fullsized":"2024-04-25T13:16:16.353029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353364+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:16.353364+0000","last_peered":"2024-04-25T13:16:16.353364+0000","last_clean":"2024-04-25T13:16:16.353364+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:16.353364+0000","last_undegraded":"2024-04-25T13:16:16.353364+0000","last_fullsized":"2024-04-25T13:16:16.353364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:44.821443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245843+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:16.245843+0000","last_peered":"2024-04-25T13:16:16.245843+0000","last_clean":"2024-04-25T13:16:16.245843+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:16.245843+0000","last_undegraded":"2024-04-25T13:16:16.245843+0000","last_fullsized":"2024-04-25T13:16:16.245843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241900+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:15.241900+0000","last_peered":"2024-04-25T13:16:15.241900+0000","last_clean":"2024-04-25T13:16:15.241900+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:15.241900+0000","last_undegraded":"2024-04-25T13:16:15.241900+0000","last_fullsized":"2024-04-25T13:16:15.241900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354206+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:16.354206+0000","last_peered":"2024-04-25T13:16:16.354206+0000","last_clean":"2024-04-25T13:16:16.354206+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354206+0000","last_undegraded":"2024-04-25T13:16:16.354206+0000","last_fullsized":"2024-04-25T13:16:16.354206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354360+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:16.354360+0000","last_peered":"2024-04-25T13:16:16.354360+0000","last_clean":"2024-04-25T13:16:16.354360+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:16.354360+0000","last_undegraded":"2024-04-25T13:16:16.354360+0000","last_fullsized":"2024-04-25T13:16:16.354360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239639+0000","last_change":"2024-04-25T13:16:10.239397+0000","last_active":"2024-04-25T13:16:15.239639+0000","last_peered":"2024-04-25T13:16:15.239639+0000","last_clean":"2024-04-25T13:16:15.239639+0000","last_became_active":"2024-04-25T13:16:10.239142+0000","last_became_peered":"2024-04-25T13:16:10.239142+0000","last_unstale":"2024-04-25T13:16:15.239639+0000","last_undegraded":"2024-04-25T13:16:15.239639+0000","last_fullsized":"2024-04-25T13:16:15.239639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:10.151896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245495+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:16.245495+0000","last_peered":"2024-04-25T13:16:16.245495+0000","last_clean":"2024-04-25T13:16:16.245495+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:16.245495+0000","last_undegraded":"2024-04-25T13:16:16.245495+0000","last_fullsized":"2024-04-25T13:16:16.245495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239010+0000","last_change":"2024-04-25T13:16:10.224097+0000","last_active":"2024-04-25T13:16:15.239010+0000","last_peered":"2024-04-25T13:16:15.239010+0000","last_clean":"2024-04-25T13:16:15.239010+0000","last_became_active":"2024-04-25T13:16:10.222594+0000","last_became_peered":"2024-04-25T13:16:10.222594+0000","last_unstale":"2024-04-25T13:16:15.239010+0000","last_undegraded":"2024-04-25T13:16:15.239010+0000","last_fullsized":"2024-04-25T13:16:15.239010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:21.148411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353185+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:16.353185+0000","last_peered":"2024-04-25T13:16:16.353185+0000","last_clean":"2024-04-25T13:16:16.353185+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:16.353185+0000","last_undegraded":"2024-04-25T13:16:16.353185+0000","last_fullsized":"2024-04-25T13:16:16.353185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239336+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:15.239336+0000","last_peered":"2024-04-25T13:16:15.239336+0000","last_clean":"2024-04-25T13:16:15.239336+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:15.239336+0000","last_undegraded":"2024-04-25T13:16:15.239336+0000","last_fullsized":"2024-04-25T13:16:15.239336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353309+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:16.353309+0000","last_peered":"2024-04-25T13:16:16.353309+0000","last_clean":"2024-04-25T13:16:16.353309+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:16.353309+0000","last_undegraded":"2024-04-25T13:16:16.353309+0000","last_fullsized":"2024-04-25T13:16:16.353309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353609+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:16.353609+0000","last_peered":"2024-04-25T13:16:16.353609+0000","last_clean":"2024-04-25T13:16:16.353609+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:16.353609+0000","last_undegraded":"2024-04-25T13:16:16.353609+0000","last_fullsized":"2024-04-25T13:16:16.353609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:51.820664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353877+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:16.353877+0000","last_peered":"2024-04-25T13:16:16.353877+0000","last_clean":"2024-04-25T13:16:16.353877+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:16.353877+0000","last_undegraded":"2024-04-25T13:16:16.353877+0000","last_fullsized":"2024-04-25T13:16:16.353877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239431+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:15.239431+0000","last_peered":"2024-04-25T13:16:15.239431+0000","last_clean":"2024-04-25T13:16:15.239431+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:15.239431+0000","last_undegraded":"2024-04-25T13:16:15.239431+0000","last_fullsized":"2024-04-25T13:16:15.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":99976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":690982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:42.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:42.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.463+0000 7f6e3fcae640 1 Processor -- start 2024-04-25T13:16:42.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.463+0000 7f6e3fcae640 1 -- start start 2024-04-25T13:16:42.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3fcae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6e381554e0 0x7f6e3815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3fcae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e380d08a0 0x7f6e380d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3fcae640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e381558c0 con 0x7f6e380b3c00 2024-04-25T13:16:42.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3fcae640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6e380b4a80 con 0x7f6e381554e0 2024-04-25T13:16:42.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3fcae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3815f630 con 0x7f6e380d08a0 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3e24b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e380d08a0 0x7f6e380d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3da4a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6e381554e0 0x7f6e3815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3e24b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e380d08a0 0x7f6e380d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:52966/0 (socket says 172.21.15.26:52966) 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3e24b640 1 -- 172.21.15.26:0/2825629297 learned_addr learned my addr 172.21.15.26:0/2825629297 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.464+0000 7f6e3d249640 1 --1- 172.21.15.26:0/2825629297 >> v1:172.21.15.169:6789/0 conn(0x7f6e380b3c00 0x7f6e380b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:46362/0 (socket says 172.21.15.26:46362) 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.465+0000 7f6e3e24b640 1 -- 172.21.15.26:0/2825629297 >> v2:172.21.15.169:3300/0 conn(0x7f6e381554e0 msgr2=0x7f6e3815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.465+0000 7f6e3e24b640 1 --2- 172.21.15.26:0/2825629297 >> v2:172.21.15.169:3300/0 conn(0x7f6e381554e0 0x7f6e3815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.465+0000 7f6e3e24b640 1 -- 172.21.15.26:0/2825629297 >> v1:172.21.15.169:6789/0 conn(0x7f6e380b3c00 legacy=0x7f6e380b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.465+0000 7f6e3e24b640 1 -- 172.21.15.26:0/2825629297 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e380cb8c0 con 0x7f6e380d08a0 2024-04-25T13:16:42.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.465+0000 7f6e3da4a640 1 --2- 172.21.15.26:0/2825629297 >> v2:172.21.15.169:3300/0 conn(0x7f6e381554e0 0x7f6e3815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.465+0000 7f6e3e24b640 1 --2- 172.21.15.26:0/2825629297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e380d08a0 0x7f6e380d0cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009e50 tx=0x7f6e3002a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80802e74bd11df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.465+0000 7f6e3ca48640 1 -- 172.21.15.26:0/2825629297 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30036070 con 0x7f6e380d08a0 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3ca48640 1 -- 172.21.15.26:0/2825629297 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e30031600 con 0x7f6e380d08a0 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3ca48640 1 -- 172.21.15.26:0/2825629297 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e300319d0 con 0x7f6e380d08a0 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2825629297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e380d08a0 msgr2=0x7f6e380d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2825629297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e380d08a0 0x7f6e380d0cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009e50 tx=0x7f6e3002a7a0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2825629297 shutdown_connections 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2825629297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e380d08a0 0x7f6e380d0cd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2825629297 >> v2:172.21.15.169:3300/0 conn(0x7f6e381554e0 0x7f6e3815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2825629297 >> 172.21.15.26:0/2825629297 conn(0x7f6e38074d50 msgr2=0x7f6e38075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2825629297 shutdown_connections 2024-04-25T13:16:42.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.466+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2825629297 wait complete. 2024-04-25T13:16:42.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.467+0000 7f6e3fcae640 1 Processor -- start 2024-04-25T13:16:42.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.467+0000 7f6e3fcae640 1 -- start start 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3fcae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e380b3c00 0x7f6e381574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3fcae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e380d08a0 0x7f6e3815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3fcae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e381554e0 0x7f6e38150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3fcae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6e380b4430 con 0x7f6e380d08a0 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3fcae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e380b4150 con 0x7f6e380b3c00 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3fcae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6e380b4710 con 0x7f6e381554e0 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e380d08a0 0x7f6e3815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e380d08a0 0x7f6e3815c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36958/0 (socket says 172.21.15.26:36958) 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 -- 172.21.15.26:0/2306768921 learned_addr learned my addr 172.21.15.26:0/2306768921 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3e24b640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e381554e0 0x7f6e38150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3da4a640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e380b3c00 0x7f6e381574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 -- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e381554e0 msgr2=0x7f6e38150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e381554e0 0x7f6e38150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 -- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e380b3c00 msgr2=0x7f6e381574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e380b3c00 0x7f6e381574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.468+0000 7f6e3d249640 1 -- 172.21.15.26:0/2306768921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e380ca500 con 0x7f6e380d08a0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.469+0000 7f6e3d249640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e380d08a0 0x7f6e3815c2b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c3f0 tx=0x7f6e2800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.469+0000 7f6e2e7fc640 1 -- 172.21.15.26:0/2306768921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e280074e0 con 0x7f6e380d08a0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.469+0000 7f6e2e7fc640 1 -- 172.21.15.26:0/2306768921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28007680 con 0x7f6e380d08a0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.469+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e380ca7c0 con 0x7f6e380d08a0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.469+0000 7f6e2e7fc640 1 -- 172.21.15.26:0/2306768921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28004a00 con 0x7f6e380d08a0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.469+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381569f0 con 0x7f6e380d08a0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.470+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e38075b30 con 0x7f6e380d08a0 2024-04-25T13:16:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.470+0000 7f6e2e7fc640 1 -- 172.21.15.26:0/2306768921 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e2801a020 con 0x7f6e380d08a0 2024-04-25T13:16:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.471+0000 7f6e2e7fc640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.471+0000 7f6e2e7fc640 1 -- 172.21.15.26:0/2306768921 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6e2808b6a0 con 0x7f6e380d08a0 2024-04-25T13:16:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.471+0000 7f6e3da4a640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.472+0000 7f6e3da4a640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009560 tx=0x7f6e34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.475+0000 7f6e2e7fc640 1 -- 172.21.15.26:0/2306768921 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e38075b30 con 0x7f6e380d08a0 2024-04-25T13:16:42.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.657+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e380cad60 con 0x7f6e1c06c8f0 2024-04-25T13:16:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.666+0000 7f6e2e7fc640 1 -- 172.21.15.26:0/2306768921 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f6e380cad60 con 0x7f6e1c06c8f0 2024-04-25T13:16:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:16:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6e1c06c8f0 msgr2=0x7f6e1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009560 tx=0x7f6e34008040 comp rx=0 tx=0).stop 2024-04-25T13:16:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e380d08a0 msgr2=0x7f6e3815c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e380d08a0 0x7f6e3815c2b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c3f0 tx=0x7f6e2800c8b0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 shutdown_connections 2024-04-25T13:16:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6e381554e0 0x7f6e38150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e380d08a0 0x7f6e3815c2b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 --2- 172.21.15.26:0/2306768921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e380b3c00 0x7f6e381574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 >> 172.21.15.26:0/2306768921 conn(0x7f6e38074d50 msgr2=0x7f6e380cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 shutdown_connections 2024-04-25T13:16:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.669+0000 7f6e3fcae640 1 -- 172.21.15.26:0/2306768921 wait complete. 2024-04-25T13:16:42.680 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T13:16:41.170725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1989824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002988"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353534+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:16:16.353534+0000","last_peered":"2024-04-25T13:16:16.353534+0000","last_clean":"2024-04-25T13:16:16.353534+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:16:16.353534+0000","last_undegraded":"2024-04-25T13:16:16.353534+0000","last_fullsized":"2024-04-25T13:16:16.353534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:27.622324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246107+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:16.246107+0000","last_peered":"2024-04-25T13:16:16.246107+0000","last_clean":"2024-04-25T13:16:16.246107+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:16.246107+0000","last_undegraded":"2024-04-25T13:16:16.246107+0000","last_fullsized":"2024-04-25T13:16:16.246107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245536+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:16.245536+0000","last_peered":"2024-04-25T13:16:16.245536+0000","last_clean":"2024-04-25T13:16:16.245536+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:16.245536+0000","last_undegraded":"2024-04-25T13:16:16.245536+0000","last_fullsized":"2024-04-25T13:16:16.245536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246261+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:16.246261+0000","last_peered":"2024-04-25T13:16:16.246261+0000","last_clean":"2024-04-25T13:16:16.246261+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:16.246261+0000","last_undegraded":"2024-04-25T13:16:16.246261+0000","last_fullsized":"2024-04-25T13:16:16.246261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353395+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:16.353395+0000","last_peered":"2024-04-25T13:16:16.353395+0000","last_clean":"2024-04-25T13:16:16.353395+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:16.353395+0000","last_undegraded":"2024-04-25T13:16:16.353395+0000","last_fullsized":"2024-04-25T13:16:16.353395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:07.806920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241491+0000","last_change":"2024-04-25T13:16:14.257938+0000","last_active":"2024-04-25T13:16:15.241491+0000","last_peered":"2024-04-25T13:16:15.241491+0000","last_clean":"2024-04-25T13:16:15.241491+0000","last_became_active":"2024-04-25T13:16:14.257583+0000","last_became_peered":"2024-04-25T13:16:14.257583+0000","last_unstale":"2024-04-25T13:16:15.241491+0000","last_undegraded":"2024-04-25T13:16:15.241491+0000","last_fullsized":"2024-04-25T13:16:15.241491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:00.046474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239900+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:16:15.239900+0000","last_peered":"2024-04-25T13:16:15.239900+0000","last_clean":"2024-04-25T13:16:15.239900+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:16:15.239900+0000","last_undegraded":"2024-04-25T13:16:15.239900+0000","last_fullsized":"2024-04-25T13:16:15.239900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353492+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:16.353492+0000","last_peered":"2024-04-25T13:16:16.353492+0000","last_clean":"2024-04-25T13:16:16.353492+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:16.353492+0000","last_undegraded":"2024-04-25T13:16:16.353492+0000","last_fullsized":"2024-04-25T13:16:16.353492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242398+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:15.242398+0000","last_peered":"2024-04-25T13:16:15.242398+0000","last_clean":"2024-04-25T13:16:15.242398+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:15.242398+0000","last_undegraded":"2024-04-25T13:16:15.242398+0000","last_fullsized":"2024-04-25T13:16:15.242398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239287+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:16:15.239287+0000","last_peered":"2024-04-25T13:16:15.239287+0000","last_clean":"2024-04-25T13:16:15.239287+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:16:15.239287+0000","last_undegraded":"2024-04-25T13:16:15.239287+0000","last_fullsized":"2024-04-25T13:16:15.239287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353813+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:16.353813+0000","last_peered":"2024-04-25T13:16:16.353813+0000","last_clean":"2024-04-25T13:16:16.353813+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:16.353813+0000","last_undegraded":"2024-04-25T13:16:16.353813+0000","last_fullsized":"2024-04-25T13:16:16.353813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241607+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:15.241607+0000","last_peered":"2024-04-25T13:16:15.241607+0000","last_clean":"2024-04-25T13:16:15.241607+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:15.241607+0000","last_undegraded":"2024-04-25T13:16:15.241607+0000","last_fullsized":"2024-04-25T13:16:15.241607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353968+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:16.353968+0000","last_peered":"2024-04-25T13:16:16.353968+0000","last_clean":"2024-04-25T13:16:16.353968+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:16.353968+0000","last_undegraded":"2024-04-25T13:16:16.353968+0000","last_fullsized":"2024-04-25T13:16:16.353968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239547+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:15.239547+0000","last_peered":"2024-04-25T13:16:15.239547+0000","last_clean":"2024-04-25T13:16:15.239547+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:15.239547+0000","last_undegraded":"2024-04-25T13:16:15.239547+0000","last_fullsized":"2024-04-25T13:16:15.239547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242365+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:15.242365+0000","last_peered":"2024-04-25T13:16:15.242365+0000","last_clean":"2024-04-25T13:16:15.242365+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:15.242365+0000","last_undegraded":"2024-04-25T13:16:15.242365+0000","last_fullsized":"2024-04-25T13:16:15.242365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245954+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:16.245954+0000","last_peered":"2024-04-25T13:16:16.245954+0000","last_clean":"2024-04-25T13:16:16.245954+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:16.245954+0000","last_undegraded":"2024-04-25T13:16:16.245954+0000","last_fullsized":"2024-04-25T13:16:16.245954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353731+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:16.353731+0000","last_peered":"2024-04-25T13:16:16.353731+0000","last_clean":"2024-04-25T13:16:16.353731+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:16.353731+0000","last_undegraded":"2024-04-25T13:16:16.353731+0000","last_fullsized":"2024-04-25T13:16:16.353731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241972+0000","last_change":"2024-04-25T13:16:14.261022+0000","last_active":"2024-04-25T13:16:15.241972+0000","last_peered":"2024-04-25T13:16:15.241972+0000","last_clean":"2024-04-25T13:16:15.241972+0000","last_became_active":"2024-04-25T13:16:14.260540+0000","last_became_peered":"2024-04-25T13:16:14.260540+0000","last_unstale":"2024-04-25T13:16:15.241972+0000","last_undegraded":"2024-04-25T13:16:15.241972+0000","last_fullsized":"2024-04-25T13:16:15.241972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:17.727873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245714+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:16.245714+0000","last_peered":"2024-04-25T13:16:16.245714+0000","last_clean":"2024-04-25T13:16:16.245714+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:16.245714+0000","last_undegraded":"2024-04-25T13:16:16.245714+0000","last_fullsized":"2024-04-25T13:16:16.245714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353398+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:16:16.353398+0000","last_peered":"2024-04-25T13:16:16.353398+0000","last_clean":"2024-04-25T13:16:16.353398+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:16:16.353398+0000","last_undegraded":"2024-04-25T13:16:16.353398+0000","last_fullsized":"2024-04-25T13:16:16.353398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354184+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:16.354184+0000","last_peered":"2024-04-25T13:16:16.354184+0000","last_clean":"2024-04-25T13:16:16.354184+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:16.354184+0000","last_undegraded":"2024-04-25T13:16:16.354184+0000","last_fullsized":"2024-04-25T13:16:16.354184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241824+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:15.241824+0000","last_peered":"2024-04-25T13:16:15.241824+0000","last_clean":"2024-04-25T13:16:15.241824+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:15.241824+0000","last_undegraded":"2024-04-25T13:16:15.241824+0000","last_fullsized":"2024-04-25T13:16:15.241824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238962+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:15.238962+0000","last_peered":"2024-04-25T13:16:15.238962+0000","last_clean":"2024-04-25T13:16:15.238962+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:15.238962+0000","last_undegraded":"2024-04-25T13:16:15.238962+0000","last_fullsized":"2024-04-25T13:16:15.238962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242094+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:15.242094+0000","last_peered":"2024-04-25T13:16:15.242094+0000","last_clean":"2024-04-25T13:16:15.242094+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:15.242094+0000","last_undegraded":"2024-04-25T13:16:15.242094+0000","last_fullsized":"2024-04-25T13:16:15.242094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354392+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:16.354392+0000","last_peered":"2024-04-25T13:16:16.354392+0000","last_clean":"2024-04-25T13:16:16.354392+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:16.354392+0000","last_undegraded":"2024-04-25T13:16:16.354392+0000","last_fullsized":"2024-04-25T13:16:16.354392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:07.387828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354625+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:16:16.354625+0000","last_peered":"2024-04-25T13:16:16.354625+0000","last_clean":"2024-04-25T13:16:16.354625+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:16:16.354625+0000","last_undegraded":"2024-04-25T13:16:16.354625+0000","last_fullsized":"2024-04-25T13:16:16.354625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241492+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:15.241492+0000","last_peered":"2024-04-25T13:16:15.241492+0000","last_clean":"2024-04-25T13:16:15.241492+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:15.241492+0000","last_undegraded":"2024-04-25T13:16:15.241492+0000","last_fullsized":"2024-04-25T13:16:15.241492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246222+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:16.246222+0000","last_peered":"2024-04-25T13:16:16.246222+0000","last_clean":"2024-04-25T13:16:16.246222+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:16.246222+0000","last_undegraded":"2024-04-25T13:16:16.246222+0000","last_fullsized":"2024-04-25T13:16:16.246222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353936+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:16.353936+0000","last_peered":"2024-04-25T13:16:16.353936+0000","last_clean":"2024-04-25T13:16:16.353936+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:16.353936+0000","last_undegraded":"2024-04-25T13:16:16.353936+0000","last_fullsized":"2024-04-25T13:16:16.353936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245445+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:16.245445+0000","last_peered":"2024-04-25T13:16:16.245445+0000","last_clean":"2024-04-25T13:16:16.245445+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:16.245445+0000","last_undegraded":"2024-04-25T13:16:16.245445+0000","last_fullsized":"2024-04-25T13:16:16.245445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354537+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:16.354537+0000","last_peered":"2024-04-25T13:16:16.354537+0000","last_clean":"2024-04-25T13:16:16.354537+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:16.354537+0000","last_undegraded":"2024-04-25T13:16:16.354537+0000","last_fullsized":"2024-04-25T13:16:16.354537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239990+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:15.239990+0000","last_peered":"2024-04-25T13:16:15.239990+0000","last_clean":"2024-04-25T13:16:15.239990+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:15.239990+0000","last_undegraded":"2024-04-25T13:16:15.239990+0000","last_fullsized":"2024-04-25T13:16:15.239990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:52.881166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354421+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:16.354421+0000","last_peered":"2024-04-25T13:16:16.354421+0000","last_clean":"2024-04-25T13:16:16.354421+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354421+0000","last_undegraded":"2024-04-25T13:16:16.354421+0000","last_fullsized":"2024-04-25T13:16:16.354421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354591+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:16.354591+0000","last_peered":"2024-04-25T13:16:16.354591+0000","last_clean":"2024-04-25T13:16:16.354591+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:16.354591+0000","last_undegraded":"2024-04-25T13:16:16.354591+0000","last_fullsized":"2024-04-25T13:16:16.354591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353448+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:16.353448+0000","last_peered":"2024-04-25T13:16:16.353448+0000","last_clean":"2024-04-25T13:16:16.353448+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:16.353448+0000","last_undegraded":"2024-04-25T13:16:16.353448+0000","last_fullsized":"2024-04-25T13:16:16.353448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242591+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:15.242591+0000","last_peered":"2024-04-25T13:16:15.242591+0000","last_clean":"2024-04-25T13:16:15.242591+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:15.242591+0000","last_undegraded":"2024-04-25T13:16:15.242591+0000","last_fullsized":"2024-04-25T13:16:15.242591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354376+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:16:16.354376+0000","last_peered":"2024-04-25T13:16:16.354376+0000","last_clean":"2024-04-25T13:16:16.354376+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:16:16.354376+0000","last_undegraded":"2024-04-25T13:16:16.354376+0000","last_fullsized":"2024-04-25T13:16:16.354376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354448+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:16.354448+0000","last_peered":"2024-04-25T13:16:16.354448+0000","last_clean":"2024-04-25T13:16:16.354448+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:16.354448+0000","last_undegraded":"2024-04-25T13:16:16.354448+0000","last_fullsized":"2024-04-25T13:16:16.354448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354505+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:16.354505+0000","last_peered":"2024-04-25T13:16:16.354505+0000","last_clean":"2024-04-25T13:16:16.354505+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:16.354505+0000","last_undegraded":"2024-04-25T13:16:16.354505+0000","last_fullsized":"2024-04-25T13:16:16.354505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238775+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:16:15.238775+0000","last_peered":"2024-04-25T13:16:15.238775+0000","last_clean":"2024-04-25T13:16:15.238775+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:16:15.238775+0000","last_undegraded":"2024-04-25T13:16:15.238775+0000","last_fullsized":"2024-04-25T13:16:15.238775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354340+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:16.354340+0000","last_peered":"2024-04-25T13:16:16.354340+0000","last_clean":"2024-04-25T13:16:16.354340+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:16.354340+0000","last_undegraded":"2024-04-25T13:16:16.354340+0000","last_fullsized":"2024-04-25T13:16:16.354340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.352967+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:16.352967+0000","last_peered":"2024-04-25T13:16:16.352967+0000","last_clean":"2024-04-25T13:16:16.352967+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:16.352967+0000","last_undegraded":"2024-04-25T13:16:16.352967+0000","last_fullsized":"2024-04-25T13:16:16.352967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:14.197407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239182+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:15.239182+0000","last_peered":"2024-04-25T13:16:15.239182+0000","last_clean":"2024-04-25T13:16:15.239182+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:15.239182+0000","last_undegraded":"2024-04-25T13:16:15.239182+0000","last_fullsized":"2024-04-25T13:16:15.239182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354197+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:16.354197+0000","last_peered":"2024-04-25T13:16:16.354197+0000","last_clean":"2024-04-25T13:16:16.354197+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:16.354197+0000","last_undegraded":"2024-04-25T13:16:16.354197+0000","last_fullsized":"2024-04-25T13:16:16.354197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:00.494861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245825+0000","last_change":"2024-04-25T13:16:10.234248+0000","last_active":"2024-04-25T13:16:16.245825+0000","last_peered":"2024-04-25T13:16:16.245825+0000","last_clean":"2024-04-25T13:16:16.245825+0000","last_became_active":"2024-04-25T13:16:10.233963+0000","last_became_peered":"2024-04-25T13:16:10.233963+0000","last_unstale":"2024-04-25T13:16:16.245825+0000","last_undegraded":"2024-04-25T13:16:16.245825+0000","last_fullsized":"2024-04-25T13:16:16.245825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:04.216005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353488+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:16.353488+0000","last_peered":"2024-04-25T13:16:16.353488+0000","last_clean":"2024-04-25T13:16:16.353488+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:16.353488+0000","last_undegraded":"2024-04-25T13:16:16.353488+0000","last_fullsized":"2024-04-25T13:16:16.353488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239179+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:15.239179+0000","last_peered":"2024-04-25T13:16:15.239179+0000","last_clean":"2024-04-25T13:16:15.239179+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:15.239179+0000","last_undegraded":"2024-04-25T13:16:15.239179+0000","last_fullsized":"2024-04-25T13:16:15.239179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354218+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:16.354218+0000","last_peered":"2024-04-25T13:16:16.354218+0000","last_clean":"2024-04-25T13:16:16.354218+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:16.354218+0000","last_undegraded":"2024-04-25T13:16:16.354218+0000","last_fullsized":"2024-04-25T13:16:16.354218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239814+0000","last_change":"2024-04-25T13:16:10.234837+0000","last_active":"2024-04-25T13:16:15.239814+0000","last_peered":"2024-04-25T13:16:15.239814+0000","last_clean":"2024-04-25T13:16:15.239814+0000","last_became_active":"2024-04-25T13:16:10.234555+0000","last_became_peered":"2024-04-25T13:16:10.234555+0000","last_unstale":"2024-04-25T13:16:15.239814+0000","last_undegraded":"2024-04-25T13:16:15.239814+0000","last_fullsized":"2024-04-25T13:16:15.239814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:51.058397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238900+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:16:15.238900+0000","last_peered":"2024-04-25T13:16:15.238900+0000","last_clean":"2024-04-25T13:16:15.238900+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:16:15.238900+0000","last_undegraded":"2024-04-25T13:16:15.238900+0000","last_fullsized":"2024-04-25T13:16:15.238900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353858+0000","last_change":"2024-04-25T13:16:14.252829+0000","last_active":"2024-04-25T13:16:16.353858+0000","last_peered":"2024-04-25T13:16:16.353858+0000","last_clean":"2024-04-25T13:16:16.353858+0000","last_became_active":"2024-04-25T13:16:14.252177+0000","last_became_peered":"2024-04-25T13:16:14.252177+0000","last_unstale":"2024-04-25T13:16:16.353858+0000","last_undegraded":"2024-04-25T13:16:16.353858+0000","last_fullsized":"2024-04-25T13:16:16.353858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:36.730765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353599+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:16.353599+0000","last_peered":"2024-04-25T13:16:16.353599+0000","last_clean":"2024-04-25T13:16:16.353599+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:16.353599+0000","last_undegraded":"2024-04-25T13:16:16.353599+0000","last_fullsized":"2024-04-25T13:16:16.353599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354155+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:16.354155+0000","last_peered":"2024-04-25T13:16:16.354155+0000","last_clean":"2024-04-25T13:16:16.354155+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:16.354155+0000","last_undegraded":"2024-04-25T13:16:16.354155+0000","last_fullsized":"2024-04-25T13:16:16.354155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353335+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:16.353335+0000","last_peered":"2024-04-25T13:16:16.353335+0000","last_clean":"2024-04-25T13:16:16.353335+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:16.353335+0000","last_undegraded":"2024-04-25T13:16:16.353335+0000","last_fullsized":"2024-04-25T13:16:16.353335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:35.815826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239702+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:15.239702+0000","last_peered":"2024-04-25T13:16:15.239702+0000","last_clean":"2024-04-25T13:16:15.239702+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:15.239702+0000","last_undegraded":"2024-04-25T13:16:15.239702+0000","last_fullsized":"2024-04-25T13:16:15.239702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238960+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:16:15.238960+0000","last_peered":"2024-04-25T13:16:15.238960+0000","last_clean":"2024-04-25T13:16:15.238960+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:16:15.238960+0000","last_undegraded":"2024-04-25T13:16:15.238960+0000","last_fullsized":"2024-04-25T13:16:15.238960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353010+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:16.353010+0000","last_peered":"2024-04-25T13:16:16.353010+0000","last_clean":"2024-04-25T13:16:16.353010+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:16.353010+0000","last_undegraded":"2024-04-25T13:16:16.353010+0000","last_fullsized":"2024-04-25T13:16:16.353010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239534+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:15.239534+0000","last_peered":"2024-04-25T13:16:15.239534+0000","last_clean":"2024-04-25T13:16:15.239534+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:15.239534+0000","last_undegraded":"2024-04-25T13:16:15.239534+0000","last_fullsized":"2024-04-25T13:16:15.239534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242078+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:15.242078+0000","last_peered":"2024-04-25T13:16:15.242078+0000","last_clean":"2024-04-25T13:16:15.242078+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:15.242078+0000","last_undegraded":"2024-04-25T13:16:15.242078+0000","last_fullsized":"2024-04-25T13:16:15.242078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241484+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:15.241484+0000","last_peered":"2024-04-25T13:16:15.241484+0000","last_clean":"2024-04-25T13:16:15.241484+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:15.241484+0000","last_undegraded":"2024-04-25T13:16:15.241484+0000","last_fullsized":"2024-04-25T13:16:15.241484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239108+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:15.239108+0000","last_peered":"2024-04-25T13:16:15.239108+0000","last_clean":"2024-04-25T13:16:15.239108+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:15.239108+0000","last_undegraded":"2024-04-25T13:16:15.239108+0000","last_fullsized":"2024-04-25T13:16:15.239108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238426+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:15.238426+0000","last_peered":"2024-04-25T13:16:15.238426+0000","last_clean":"2024-04-25T13:16:15.238426+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:15.238426+0000","last_undegraded":"2024-04-25T13:16:15.238426+0000","last_fullsized":"2024-04-25T13:16:15.238426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354056+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:16.354056+0000","last_peered":"2024-04-25T13:16:16.354056+0000","last_clean":"2024-04-25T13:16:16.354056+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:16.354056+0000","last_undegraded":"2024-04-25T13:16:16.354056+0000","last_fullsized":"2024-04-25T13:16:16.354056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:15.310573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353676+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:16.353676+0000","last_peered":"2024-04-25T13:16:16.353676+0000","last_clean":"2024-04-25T13:16:16.353676+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:16.353676+0000","last_undegraded":"2024-04-25T13:16:16.353676+0000","last_fullsized":"2024-04-25T13:16:16.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354116+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:16:16.354116+0000","last_peered":"2024-04-25T13:16:16.354116+0000","last_clean":"2024-04-25T13:16:16.354116+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:16:16.354116+0000","last_undegraded":"2024-04-25T13:16:16.354116+0000","last_fullsized":"2024-04-25T13:16:16.354116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246099+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:16.246099+0000","last_peered":"2024-04-25T13:16:16.246099+0000","last_clean":"2024-04-25T13:16:16.246099+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:16.246099+0000","last_undegraded":"2024-04-25T13:16:16.246099+0000","last_fullsized":"2024-04-25T13:16:16.246099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239499+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:15.239499+0000","last_peered":"2024-04-25T13:16:15.239499+0000","last_clean":"2024-04-25T13:16:15.239499+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:15.239499+0000","last_undegraded":"2024-04-25T13:16:15.239499+0000","last_fullsized":"2024-04-25T13:16:15.239499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353468+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:16.353468+0000","last_peered":"2024-04-25T13:16:16.353468+0000","last_clean":"2024-04-25T13:16:16.353468+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:16.353468+0000","last_undegraded":"2024-04-25T13:16:16.353468+0000","last_fullsized":"2024-04-25T13:16:16.353468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246276+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:16.246276+0000","last_peered":"2024-04-25T13:16:16.246276+0000","last_clean":"2024-04-25T13:16:16.246276+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:16.246276+0000","last_undegraded":"2024-04-25T13:16:16.246276+0000","last_fullsized":"2024-04-25T13:16:16.246276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353735+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:16.353735+0000","last_peered":"2024-04-25T13:16:16.353735+0000","last_clean":"2024-04-25T13:16:16.353735+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:16.353735+0000","last_undegraded":"2024-04-25T13:16:16.353735+0000","last_fullsized":"2024-04-25T13:16:16.353735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:24.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353518+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:16:16.353518+0000","last_peered":"2024-04-25T13:16:16.353518+0000","last_clean":"2024-04-25T13:16:16.353518+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:16:16.353518+0000","last_undegraded":"2024-04-25T13:16:16.353518+0000","last_fullsized":"2024-04-25T13:16:16.353518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:49.859293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353792+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:16.353792+0000","last_peered":"2024-04-25T13:16:16.353792+0000","last_clean":"2024-04-25T13:16:16.353792+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:16.353792+0000","last_undegraded":"2024-04-25T13:16:16.353792+0000","last_fullsized":"2024-04-25T13:16:16.353792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239616+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:15.239616+0000","last_peered":"2024-04-25T13:16:15.239616+0000","last_clean":"2024-04-25T13:16:15.239616+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:15.239616+0000","last_undegraded":"2024-04-25T13:16:15.239616+0000","last_fullsized":"2024-04-25T13:16:15.239616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:30.515181+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:16:30.515181+0000","last_peered":"2024-04-25T13:16:30.515181+0000","last_clean":"2024-04-25T13:16:30.515181+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:16:30.515181+0000","last_undegraded":"2024-04-25T13:16:30.515181+0000","last_fullsized":"2024-04-25T13:16:30.515181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353615+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:16.353615+0000","last_peered":"2024-04-25T13:16:16.353615+0000","last_clean":"2024-04-25T13:16:16.353615+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:16.353615+0000","last_undegraded":"2024-04-25T13:16:16.353615+0000","last_fullsized":"2024-04-25T13:16:16.353615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242098+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:15.242098+0000","last_peered":"2024-04-25T13:16:15.242098+0000","last_clean":"2024-04-25T13:16:15.242098+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:15.242098+0000","last_undegraded":"2024-04-25T13:16:15.242098+0000","last_fullsized":"2024-04-25T13:16:15.242098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354055+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:16.354055+0000","last_peered":"2024-04-25T13:16:16.354055+0000","last_clean":"2024-04-25T13:16:16.354055+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:16.354055+0000","last_undegraded":"2024-04-25T13:16:16.354055+0000","last_fullsized":"2024-04-25T13:16:16.354055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242563+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:15.242563+0000","last_peered":"2024-04-25T13:16:15.242563+0000","last_clean":"2024-04-25T13:16:15.242563+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:15.242563+0000","last_undegraded":"2024-04-25T13:16:15.242563+0000","last_fullsized":"2024-04-25T13:16:15.242563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353633+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:16.353633+0000","last_peered":"2024-04-25T13:16:16.353633+0000","last_clean":"2024-04-25T13:16:16.353633+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:16.353633+0000","last_undegraded":"2024-04-25T13:16:16.353633+0000","last_fullsized":"2024-04-25T13:16:16.353633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:59.519018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353823+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:16:16.353823+0000","last_peered":"2024-04-25T13:16:16.353823+0000","last_clean":"2024-04-25T13:16:16.353823+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:16:16.353823+0000","last_undegraded":"2024-04-25T13:16:16.353823+0000","last_fullsized":"2024-04-25T13:16:16.353823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245632+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:16.245632+0000","last_peered":"2024-04-25T13:16:16.245632+0000","last_clean":"2024-04-25T13:16:16.245632+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:16.245632+0000","last_undegraded":"2024-04-25T13:16:16.245632+0000","last_fullsized":"2024-04-25T13:16:16.245632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353701+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:16.353701+0000","last_peered":"2024-04-25T13:16:16.353701+0000","last_clean":"2024-04-25T13:16:16.353701+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:16.353701+0000","last_undegraded":"2024-04-25T13:16:16.353701+0000","last_fullsized":"2024-04-25T13:16:16.353701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354545+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:16:16.354545+0000","last_peered":"2024-04-25T13:16:16.354545+0000","last_clean":"2024-04-25T13:16:16.354545+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:16:16.354545+0000","last_undegraded":"2024-04-25T13:16:16.354545+0000","last_fullsized":"2024-04-25T13:16:16.354545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245573+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:16.245573+0000","last_peered":"2024-04-25T13:16:16.245573+0000","last_clean":"2024-04-25T13:16:16.245573+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:16.245573+0000","last_undegraded":"2024-04-25T13:16:16.245573+0000","last_fullsized":"2024-04-25T13:16:16.245573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353911+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:16.353911+0000","last_peered":"2024-04-25T13:16:16.353911+0000","last_clean":"2024-04-25T13:16:16.353911+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:16.353911+0000","last_undegraded":"2024-04-25T13:16:16.353911+0000","last_fullsized":"2024-04-25T13:16:16.353911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.475502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353851+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:16.353851+0000","last_peered":"2024-04-25T13:16:16.353851+0000","last_clean":"2024-04-25T13:16:16.353851+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:16.353851+0000","last_undegraded":"2024-04-25T13:16:16.353851+0000","last_fullsized":"2024-04-25T13:16:16.353851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353153+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:16.353153+0000","last_peered":"2024-04-25T13:16:16.353153+0000","last_clean":"2024-04-25T13:16:16.353153+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:16.353153+0000","last_undegraded":"2024-04-25T13:16:16.353153+0000","last_fullsized":"2024-04-25T13:16:16.353153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354404+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:16.354404+0000","last_peered":"2024-04-25T13:16:16.354404+0000","last_clean":"2024-04-25T13:16:16.354404+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:16.354404+0000","last_undegraded":"2024-04-25T13:16:16.354404+0000","last_fullsized":"2024-04-25T13:16:16.354404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245598+0000","last_change":"2024-04-25T13:16:10.230726+0000","last_active":"2024-04-25T13:16:16.245598+0000","last_peered":"2024-04-25T13:16:16.245598+0000","last_clean":"2024-04-25T13:16:16.245598+0000","last_became_active":"2024-04-25T13:16:10.228712+0000","last_became_peered":"2024-04-25T13:16:10.228712+0000","last_unstale":"2024-04-25T13:16:16.245598+0000","last_undegraded":"2024-04-25T13:16:16.245598+0000","last_fullsized":"2024-04-25T13:16:16.245598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:43.499305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245839+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:16.245839+0000","last_peered":"2024-04-25T13:16:16.245839+0000","last_clean":"2024-04-25T13:16:16.245839+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:16.245839+0000","last_undegraded":"2024-04-25T13:16:16.245839+0000","last_fullsized":"2024-04-25T13:16:16.245839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354063+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:16.354063+0000","last_peered":"2024-04-25T13:16:16.354063+0000","last_clean":"2024-04-25T13:16:16.354063+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:16.354063+0000","last_undegraded":"2024-04-25T13:16:16.354063+0000","last_fullsized":"2024-04-25T13:16:16.354063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353420+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:16.353420+0000","last_peered":"2024-04-25T13:16:16.353420+0000","last_clean":"2024-04-25T13:16:16.353420+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:16.353420+0000","last_undegraded":"2024-04-25T13:16:16.353420+0000","last_fullsized":"2024-04-25T13:16:16.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238725+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:15.238725+0000","last_peered":"2024-04-25T13:16:15.238725+0000","last_clean":"2024-04-25T13:16:15.238725+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:15.238725+0000","last_undegraded":"2024-04-25T13:16:15.238725+0000","last_fullsized":"2024-04-25T13:16:15.238725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246106+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:16:16.246106+0000","last_peered":"2024-04-25T13:16:16.246106+0000","last_clean":"2024-04-25T13:16:16.246106+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:16:16.246106+0000","last_undegraded":"2024-04-25T13:16:16.246106+0000","last_fullsized":"2024-04-25T13:16:16.246106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241834+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:15.241834+0000","last_peered":"2024-04-25T13:16:15.241834+0000","last_clean":"2024-04-25T13:16:15.241834+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:15.241834+0000","last_undegraded":"2024-04-25T13:16:15.241834+0000","last_fullsized":"2024-04-25T13:16:15.241834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246117+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:16.246117+0000","last_peered":"2024-04-25T13:16:16.246117+0000","last_clean":"2024-04-25T13:16:16.246117+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:16.246117+0000","last_undegraded":"2024-04-25T13:16:16.246117+0000","last_fullsized":"2024-04-25T13:16:16.246117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353553+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:16.353553+0000","last_peered":"2024-04-25T13:16:16.353553+0000","last_clean":"2024-04-25T13:16:16.353553+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:16.353553+0000","last_undegraded":"2024-04-25T13:16:16.353553+0000","last_fullsized":"2024-04-25T13:16:16.353553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238557+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:15.238557+0000","last_peered":"2024-04-25T13:16:15.238557+0000","last_clean":"2024-04-25T13:16:15.238557+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:15.238557+0000","last_undegraded":"2024-04-25T13:16:15.238557+0000","last_fullsized":"2024-04-25T13:16:15.238557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353362+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:16.353362+0000","last_peered":"2024-04-25T13:16:16.353362+0000","last_clean":"2024-04-25T13:16:16.353362+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:16.353362+0000","last_undegraded":"2024-04-25T13:16:16.353362+0000","last_fullsized":"2024-04-25T13:16:16.353362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353399+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:16.353399+0000","last_peered":"2024-04-25T13:16:16.353399+0000","last_clean":"2024-04-25T13:16:16.353399+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:16.353399+0000","last_undegraded":"2024-04-25T13:16:16.353399+0000","last_fullsized":"2024-04-25T13:16:16.353399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:23.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246373+0000","last_change":"2024-04-25T13:16:10.236483+0000","last_active":"2024-04-25T13:16:16.246373+0000","last_peered":"2024-04-25T13:16:16.246373+0000","last_clean":"2024-04-25T13:16:16.246373+0000","last_became_active":"2024-04-25T13:16:10.236179+0000","last_became_peered":"2024-04-25T13:16:10.236179+0000","last_unstale":"2024-04-25T13:16:16.246373+0000","last_undegraded":"2024-04-25T13:16:16.246373+0000","last_fullsized":"2024-04-25T13:16:16.246373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:23.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354239+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:16.354239+0000","last_peered":"2024-04-25T13:16:16.354239+0000","last_clean":"2024-04-25T13:16:16.354239+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:16.354239+0000","last_undegraded":"2024-04-25T13:16:16.354239+0000","last_fullsized":"2024-04-25T13:16:16.354239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354433+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:16.354433+0000","last_peered":"2024-04-25T13:16:16.354433+0000","last_clean":"2024-04-25T13:16:16.354433+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:16.354433+0000","last_undegraded":"2024-04-25T13:16:16.354433+0000","last_fullsized":"2024-04-25T13:16:16.354433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246083+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:16.246083+0000","last_peered":"2024-04-25T13:16:16.246083+0000","last_clean":"2024-04-25T13:16:16.246083+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:16.246083+0000","last_undegraded":"2024-04-25T13:16:16.246083+0000","last_fullsized":"2024-04-25T13:16:16.246083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353298+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:16.353298+0000","last_peered":"2024-04-25T13:16:16.353298+0000","last_clean":"2024-04-25T13:16:16.353298+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:16.353298+0000","last_undegraded":"2024-04-25T13:16:16.353298+0000","last_fullsized":"2024-04-25T13:16:16.353298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245689+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:16.245689+0000","last_peered":"2024-04-25T13:16:16.245689+0000","last_clean":"2024-04-25T13:16:16.245689+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:16.245689+0000","last_undegraded":"2024-04-25T13:16:16.245689+0000","last_fullsized":"2024-04-25T13:16:16.245689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353453+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:16.353453+0000","last_peered":"2024-04-25T13:16:16.353453+0000","last_clean":"2024-04-25T13:16:16.353453+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:16.353453+0000","last_undegraded":"2024-04-25T13:16:16.353453+0000","last_fullsized":"2024-04-25T13:16:16.353453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353184+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:16.353184+0000","last_peered":"2024-04-25T13:16:16.353184+0000","last_clean":"2024-04-25T13:16:16.353184+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:16.353184+0000","last_undegraded":"2024-04-25T13:16:16.353184+0000","last_fullsized":"2024-04-25T13:16:16.353184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:52.980650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354190+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:16.354190+0000","last_peered":"2024-04-25T13:16:16.354190+0000","last_clean":"2024-04-25T13:16:16.354190+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:16.354190+0000","last_undegraded":"2024-04-25T13:16:16.354190+0000","last_fullsized":"2024-04-25T13:16:16.354190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239903+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:15.239903+0000","last_peered":"2024-04-25T13:16:15.239903+0000","last_clean":"2024-04-25T13:16:15.239903+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:15.239903+0000","last_undegraded":"2024-04-25T13:16:15.239903+0000","last_fullsized":"2024-04-25T13:16:15.239903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238907+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:15.238907+0000","last_peered":"2024-04-25T13:16:15.238907+0000","last_clean":"2024-04-25T13:16:15.238907+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:15.238907+0000","last_undegraded":"2024-04-25T13:16:15.238907+0000","last_fullsized":"2024-04-25T13:16:15.238907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354124+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:16.354124+0000","last_peered":"2024-04-25T13:16:16.354124+0000","last_clean":"2024-04-25T13:16:16.354124+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:16.354124+0000","last_undegraded":"2024-04-25T13:16:16.354124+0000","last_fullsized":"2024-04-25T13:16:16.354124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353029+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:16.353029+0000","last_peered":"2024-04-25T13:16:16.353029+0000","last_clean":"2024-04-25T13:16:16.353029+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:16.353029+0000","last_undegraded":"2024-04-25T13:16:16.353029+0000","last_fullsized":"2024-04-25T13:16:16.353029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353364+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:16.353364+0000","last_peered":"2024-04-25T13:16:16.353364+0000","last_clean":"2024-04-25T13:16:16.353364+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:16.353364+0000","last_undegraded":"2024-04-25T13:16:16.353364+0000","last_fullsized":"2024-04-25T13:16:16.353364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:44.821443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245843+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:16.245843+0000","last_peered":"2024-04-25T13:16:16.245843+0000","last_clean":"2024-04-25T13:16:16.245843+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:16.245843+0000","last_undegraded":"2024-04-25T13:16:16.245843+0000","last_fullsized":"2024-04-25T13:16:16.245843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241900+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:15.241900+0000","last_peered":"2024-04-25T13:16:15.241900+0000","last_clean":"2024-04-25T13:16:15.241900+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:15.241900+0000","last_undegraded":"2024-04-25T13:16:15.241900+0000","last_fullsized":"2024-04-25T13:16:15.241900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354206+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:16.354206+0000","last_peered":"2024-04-25T13:16:16.354206+0000","last_clean":"2024-04-25T13:16:16.354206+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354206+0000","last_undegraded":"2024-04-25T13:16:16.354206+0000","last_fullsized":"2024-04-25T13:16:16.354206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354360+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:16.354360+0000","last_peered":"2024-04-25T13:16:16.354360+0000","last_clean":"2024-04-25T13:16:16.354360+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:16.354360+0000","last_undegraded":"2024-04-25T13:16:16.354360+0000","last_fullsized":"2024-04-25T13:16:16.354360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239639+0000","last_change":"2024-04-25T13:16:10.239397+0000","last_active":"2024-04-25T13:16:15.239639+0000","last_peered":"2024-04-25T13:16:15.239639+0000","last_clean":"2024-04-25T13:16:15.239639+0000","last_became_active":"2024-04-25T13:16:10.239142+0000","last_became_peered":"2024-04-25T13:16:10.239142+0000","last_unstale":"2024-04-25T13:16:15.239639+0000","last_undegraded":"2024-04-25T13:16:15.239639+0000","last_fullsized":"2024-04-25T13:16:15.239639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:10.151896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245495+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:16.245495+0000","last_peered":"2024-04-25T13:16:16.245495+0000","last_clean":"2024-04-25T13:16:16.245495+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:16.245495+0000","last_undegraded":"2024-04-25T13:16:16.245495+0000","last_fullsized":"2024-04-25T13:16:16.245495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239010+0000","last_change":"2024-04-25T13:16:10.224097+0000","last_active":"2024-04-25T13:16:15.239010+0000","last_peered":"2024-04-25T13:16:15.239010+0000","last_clean":"2024-04-25T13:16:15.239010+0000","last_became_active":"2024-04-25T13:16:10.222594+0000","last_became_peered":"2024-04-25T13:16:10.222594+0000","last_unstale":"2024-04-25T13:16:15.239010+0000","last_undegraded":"2024-04-25T13:16:15.239010+0000","last_fullsized":"2024-04-25T13:16:15.239010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:21.148411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353185+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:16.353185+0000","last_peered":"2024-04-25T13:16:16.353185+0000","last_clean":"2024-04-25T13:16:16.353185+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:16.353185+0000","last_undegraded":"2024-04-25T13:16:16.353185+0000","last_fullsized":"2024-04-25T13:16:16.353185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239336+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:15.239336+0000","last_peered":"2024-04-25T13:16:15.239336+0000","last_clean":"2024-04-25T13:16:15.239336+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:15.239336+0000","last_undegraded":"2024-04-25T13:16:15.239336+0000","last_fullsized":"2024-04-25T13:16:15.239336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353309+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:16.353309+0000","last_peered":"2024-04-25T13:16:16.353309+0000","last_clean":"2024-04-25T13:16:16.353309+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:16.353309+0000","last_undegraded":"2024-04-25T13:16:16.353309+0000","last_fullsized":"2024-04-25T13:16:16.353309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353609+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:16.353609+0000","last_peered":"2024-04-25T13:16:16.353609+0000","last_clean":"2024-04-25T13:16:16.353609+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:16.353609+0000","last_undegraded":"2024-04-25T13:16:16.353609+0000","last_fullsized":"2024-04-25T13:16:16.353609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:51.820664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353877+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:16.353877+0000","last_peered":"2024-04-25T13:16:16.353877+0000","last_clean":"2024-04-25T13:16:16.353877+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:16.353877+0000","last_undegraded":"2024-04-25T13:16:16.353877+0000","last_fullsized":"2024-04-25T13:16:16.353877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239431+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:15.239431+0000","last_peered":"2024-04-25T13:16:15.239431+0000","last_clean":"2024-04-25T13:16:15.239431+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:15.239431+0000","last_undegraded":"2024-04-25T13:16:15.239431+0000","last_fullsized":"2024-04-25T13:16:15.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":99976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":690982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:42.685 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T13:16:42.685 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T13:16:42.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T13:16:42.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T13:16:42.686 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T13:16:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.820+0000 7f516abe2640 1 Processor -- start 2024-04-25T13:16:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516abe2640 1 -- start start 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516abe2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51640b3c00 0x7f51640b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516abe2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f51640b5450 0x7f51640d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516abe2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51641558c0 con 0x7f51641554e0 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516abe2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f51640b4a80 con 0x7f51640b3c00 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516abe2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f51640cb8c0 con 0x7f51640b5450 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f5163fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51640b3c00 0x7f51640b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516897e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f51641554e0 0x7f516415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58618/0 (socket says 172.21.15.26:58618) 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.821+0000 7f516897e640 1 -- 172.21.15.26:0/4259627217 learned_addr learned my addr 172.21.15.26:0/4259627217 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:42.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.822+0000 7f516917f640 1 --2- 172.21.15.26:0/4259627217 >> v2:172.21.15.169:3300/0 conn(0x7f51640b5450 0x7f51640d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.822+0000 7f5163fff640 1 -- 172.21.15.26:0/4259627217 >> v2:172.21.15.169:3300/0 conn(0x7f51640b5450 msgr2=0x7f51640d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.822+0000 7f5163fff640 1 --2- 172.21.15.26:0/4259627217 >> v2:172.21.15.169:3300/0 conn(0x7f51640b5450 0x7f51640d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.822+0000 7f5163fff640 1 -- 172.21.15.26:0/4259627217 >> v1:172.21.15.26:6789/0 conn(0x7f51641554e0 legacy=0x7f516415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.822+0000 7f5163fff640 1 -- 172.21.15.26:0/4259627217 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51640cbba0 con 0x7f51640b3c00 2024-04-25T13:16:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.822+0000 7f516917f640 1 --2- 172.21.15.26:0/4259627217 >> v2:172.21.15.169:3300/0 conn(0x7f51640b5450 0x7f51640d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.822+0000 7f5163fff640 1 --2- 172.21.15.26:0/4259627217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b3c00 0x7f51640b4f10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51640ce7e0 tx=0x7f515002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58778c42bf7ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f51637fe640 1 -- 172.21.15.26:0/4259627217 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150037070 con 0x7f51640b3c00 2024-04-25T13:16:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f51637fe640 1 -- 172.21.15.26:0/4259627217 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5150032440 con 0x7f51640b3c00 2024-04-25T13:16:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f51637fe640 1 -- 172.21.15.26:0/4259627217 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150032810 con 0x7f51640b3c00 2024-04-25T13:16:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 -- 172.21.15.26:0/4259627217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b3c00 msgr2=0x7f51640b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 --2- 172.21.15.26:0/4259627217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b3c00 0x7f51640b4f10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51640ce7e0 tx=0x7f515002a230 comp rx=0 tx=0).stop 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 -- 172.21.15.26:0/4259627217 shutdown_connections 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 --2- 172.21.15.26:0/4259627217 >> v2:172.21.15.169:3300/0 conn(0x7f51640b5450 0x7f51640d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 --2- 172.21.15.26:0/4259627217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b3c00 0x7f51640b4f10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 -- 172.21.15.26:0/4259627217 >> 172.21.15.26:0/4259627217 conn(0x7f5164074d50 msgr2=0x7f5164075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 -- 172.21.15.26:0/4259627217 shutdown_connections 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.823+0000 7f516abe2640 1 -- 172.21.15.26:0/4259627217 wait complete. 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.824+0000 7f516abe2640 1 Processor -- start 2024-04-25T13:16:42.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.824+0000 7f516abe2640 1 -- start start 2024-04-25T13:16:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f516abe2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51640b3c00 0x7f51640c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f516abe2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b5450 0x7f516415e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f516abe2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51641554e0 0x7f51641f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f516abe2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f51640b4710 con 0x7f51640b5450 2024-04-25T13:16:42.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f516abe2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51640b4430 con 0x7f51640b3c00 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f516abe2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f51640b3580 con 0x7f51641554e0 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f5163fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b5450 0x7f516415e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f5163fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b5450 0x7f516415e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36988/0 (socket says 172.21.15.26:36988) 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.825+0000 7f5163fff640 1 -- 172.21.15.26:0/1523846739 learned_addr learned my addr 172.21.15.26:0/1523846739 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f516917f640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51641554e0 0x7f51641f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f516897e640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51640b3c00 0x7f51640c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f5163fff640 1 -- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51641554e0 msgr2=0x7f51641f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f5163fff640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51641554e0 0x7f51641f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f5163fff640 1 -- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51640b3c00 msgr2=0x7f51640c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f5163fff640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51640b3c00 0x7f51640c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f5163fff640 1 -- 172.21.15.26:0/1523846739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516414c7b0 con 0x7f51640b5450 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f516917f640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51641554e0 0x7f51641f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f516897e640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51640b3c00 0x7f51640c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:42.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f5163fff640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b5450 0x7f516415e900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5150000c00 tx=0x7f51500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f51617fa640 1 -- 172.21.15.26:0/1523846739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150037040 con 0x7f51640b5450 2024-04-25T13:16:42.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f51617fa640 1 -- 172.21.15.26:0/1523846739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5150042070 con 0x7f51640b5450 2024-04-25T13:16:42.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51640ca220 con 0x7f51640b5450 2024-04-25T13:16:42.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f51617fa640 1 -- 172.21.15.26:0/1523846739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150030a50 con 0x7f51640b5450 2024-04-25T13:16:42.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.826+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51640ca7e0 con 0x7f51640b5450 2024-04-25T13:16:42.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.827+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5164068e40 con 0x7f51640b5450 2024-04-25T13:16:42.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.827+0000 7f51617fa640 1 -- 172.21.15.26:0/1523846739 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5150030bf0 con 0x7f51640b5450 2024-04-25T13:16:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.828+0000 7f51617fa640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f514806c8f0 0x7f514806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.828+0000 7f51617fa640 1 -- 172.21.15.26:0/1523846739 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f51500aca10 con 0x7f51640b5450 2024-04-25T13:16:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.828+0000 7f516897e640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f514806c8f0 0x7f514806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.829+0000 7f516897e640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f514806c8f0 0x7f514806edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5158000f60 tx=0x7f5158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:42.832+0000 7f51617fa640 1 -- 172.21.15.26:0/1523846739 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f515007a9f0 con 0x7f51640b5450 2024-04-25T13:16:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.070+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f51640cc890 con 0x7f51640b5450 2024-04-25T13:16:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.073+0000 7f51617fa640 1 -- 172.21.15.26:0/1523846739 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174142 (secure 0 0 0) 0x7f515007a2f0 con 0x7f51640b5450 2024-04-25T13:16:43.076 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f514806c8f0 msgr2=0x7f514806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f514806c8f0 0x7f514806edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5158000f60 tx=0x7f5158009040 comp rx=0 tx=0).stop 2024-04-25T13:16:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b5450 msgr2=0x7f516415e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b5450 0x7f516415e900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5150000c00 tx=0x7f51500046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 shutdown_connections 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f514806c8f0 0x7f514806edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51641554e0 0x7f51641f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51640b5450 0x7f516415e900 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 --2- 172.21.15.26:0/1523846739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51640b3c00 0x7f51640c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 >> 172.21.15.26:0/1523846739 conn(0x7f5164074d50 msgr2=0x7f5164153570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 shutdown_connections 2024-04-25T13:16:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.075+0000 7f516abe2640 1 -- 172.21.15.26:0/1523846739 wait complete. 2024-04-25T13:16:43.087 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1178802827},{"type":"v1","addr":"172.21.15.169:6833","nonce":1178802827}]},"active_addr":"172.21.15.169:6833/1178802827","active_change":"2024-04-25T13:15:49.152448+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4112,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":765743072}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3685219917}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3943286785}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":856182353}]}]} 2024-04-25T13:16:43.090 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T13:16:43.090 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T13:16:43.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:43.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.191+0000 7fe1c608a640 1 Processor -- start 2024-04-25T13:16:43.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.191+0000 7fe1c608a640 1 -- start start 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1c608a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00c8870 0x7fe1c015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1c608a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1c015ca00 0x7fe1c0073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1c608a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c015ce90 con 0x7fe1c0152f70 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1c608a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe1c0158fe0 con 0x7fe1c015ca00 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1c608a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c01592c0 con 0x7fe1c00c8870 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1bf7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe1c0152f70 0x7fe1c00c5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58630/0 (socket says 172.21.15.26:58630) 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1bf7fe640 1 -- 172.21.15.26:0/2812879876 learned_addr learned my addr 172.21.15.26:0/2812879876 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:43.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1bffff640 1 --2- 172.21.15.26:0/2812879876 >> v2:172.21.15.26:3300/0 conn(0x7fe1c015ca00 0x7fe1c0073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1beffd640 1 --2- 172.21.15.26:0/2812879876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00c8870 0x7fe1c015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1be7fc640 1 -- 172.21.15.26:0/2812879876 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301557914 0 0) 0x7fe1c015ce90 con 0x7fe1c0152f70 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1be7fc640 1 -- 172.21.15.26:0/2812879876 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a8003520 con 0x7fe1c0152f70 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1bffff640 1 -- 172.21.15.26:0/2812879876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00c8870 msgr2=0x7fe1c015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1bffff640 1 --2- 172.21.15.26:0/2812879876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00c8870 0x7fe1c015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1bffff640 1 -- 172.21.15.26:0/2812879876 >> v1:172.21.15.26:6789/0 conn(0x7fe1c0152f70 legacy=0x7fe1c00c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.192+0000 7fe1bffff640 1 -- 172.21.15.26:0/2812879876 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c01595a0 con 0x7fe1c015ca00 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.193+0000 7fe1bffff640 1 --2- 172.21.15.26:0/2812879876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c015ca00 0x7fe1c0073a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009d90 tx=0x7fe1b802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a862322eec2c6a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.193+0000 7fe1be7fc640 1 -- 172.21.15.26:0/2812879876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8007740 con 0x7fe1c015ca00 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.193+0000 7fe1be7fc640 1 -- 172.21.15.26:0/2812879876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b80078e0 con 0x7fe1c015ca00 2024-04-25T13:16:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.193+0000 7fe1be7fc640 1 -- 172.21.15.26:0/2812879876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8007cb0 con 0x7fe1c015ca00 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 -- 172.21.15.26:0/2812879876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c015ca00 msgr2=0x7fe1c0073a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 --2- 172.21.15.26:0/2812879876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c015ca00 0x7fe1c0073a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009d90 tx=0x7fe1b802a660 comp rx=0 tx=0).stop 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 -- 172.21.15.26:0/2812879876 shutdown_connections 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 --2- 172.21.15.26:0/2812879876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c015ca00 0x7fe1c0073a30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 --2- 172.21.15.26:0/2812879876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00c8870 0x7fe1c015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 -- 172.21.15.26:0/2812879876 >> 172.21.15.26:0/2812879876 conn(0x7fe1c0074d50 msgr2=0x7fe1c0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 -- 172.21.15.26:0/2812879876 shutdown_connections 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.194+0000 7fe1c608a640 1 -- 172.21.15.26:0/2812879876 wait complete. 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.195+0000 7fe1c608a640 1 Processor -- start 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.195+0000 7fe1c608a640 1 -- start start 2024-04-25T13:16:43.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1c608a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c00c8870 0x7fe1c01ef230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1c608a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c0152f70 0x7fe1c0150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1c608a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c015ca00 0x7fe1c0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1c608a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c0153350 con 0x7fe1c00c8870 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1c608a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c0159b60 con 0x7fe1c015ca00 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1c608a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c01534d0 con 0x7fe1c0152f70 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c00c8870 0x7fe1c01ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c00c8870 0x7fe1c01ef230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37014/0 (socket says 172.21.15.26:37014) 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 -- 172.21.15.26:0/1528295091 learned_addr learned my addr 172.21.15.26:0/1528295091 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1beffd640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c0152f70 0x7fe1c0150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bffff640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c015ca00 0x7fe1c0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 -- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c0152f70 msgr2=0x7fe1c0150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c0152f70 0x7fe1c0150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 -- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c015ca00 msgr2=0x7fe1c0157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c015ca00 0x7fe1c0157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 -- 172.21.15.26:0/1528295091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c0158800 con 0x7fe1c00c8870 2024-04-25T13:16:43.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1bf7fe640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c00c8870 0x7fe1c01ef230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c460 tx=0x7fe1b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.196+0000 7fe1a7fff640 1 -- 172.21.15.26:0/1528295091 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4017070 con 0x7fe1c00c8870 2024-04-25T13:16:43.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.197+0000 7fe1a7fff640 1 -- 172.21.15.26:0/1528295091 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b4005ce0 con 0x7fe1c00c8870 2024-04-25T13:16:43.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.197+0000 7fe1a7fff640 1 -- 172.21.15.26:0/1528295091 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4007290 con 0x7fe1c00c8870 2024-04-25T13:16:43.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.197+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c0158520 con 0x7fe1c00c8870 2024-04-25T13:16:43.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.197+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c0156e00 con 0x7fe1c00c8870 2024-04-25T13:16:43.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.197+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c0068e40 con 0x7fe1c00c8870 2024-04-25T13:16:43.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.198+0000 7fe1a7fff640 1 -- 172.21.15.26:0/1528295091 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1b401a070 con 0x7fe1c00c8870 2024-04-25T13:16:43.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.198+0000 7fe1a7fff640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.198+0000 7fe1a7fff640 1 -- 172.21.15.26:0/1528295091 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe1b408b170 con 0x7fe1c00c8870 2024-04-25T13:16:43.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.199+0000 7fe1beffd640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.199+0000 7fe1beffd640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1c01568d0 tx=0x7fe1b0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.203+0000 7fe1a7fff640 1 -- 172.21.15.26:0/1528295091 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1b4058c10 con 0x7fe1c00c8870 2024-04-25T13:16:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.389+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1c01457e0 con 0x7fe1c00c8870 2024-04-25T13:16:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.390+0000 7fe1a7fff640 1 -- 172.21.15.26:0/1528295091 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7fe1b405cf10 con 0x7fe1c00c8870 2024-04-25T13:16:43.391 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:43.391 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe1ac06c8f0 msgr2=0x7fe1ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1c01568d0 tx=0x7fe1b0009190 comp rx=0 tx=0).stop 2024-04-25T13:16:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c00c8870 msgr2=0x7fe1c01ef230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c00c8870 0x7fe1c01ef230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c460 tx=0x7fe1b400c920 comp rx=0 tx=0).stop 2024-04-25T13:16:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 shutdown_connections 2024-04-25T13:16:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c015ca00 0x7fe1c0157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c0152f70 0x7fe1c0150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 --2- 172.21.15.26:0/1528295091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1c00c8870 0x7fe1c01ef230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 >> 172.21.15.26:0/1528295091 conn(0x7fe1c0074d50 msgr2=0x7fe1c014f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 shutdown_connections 2024-04-25T13:16:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.392+0000 7fe1c608a640 1 -- 172.21.15.26:0/1528295091 wait complete. 2024-04-25T13:16:43.404 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T13:16:43.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:43.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.504+0000 7f709ede2640 1 Processor -- start 2024-04-25T13:16:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.504+0000 7f709ede2640 1 -- start start 2024-04-25T13:16:43.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.504+0000 7f709ede2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f709806bf70 0x7f709815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.504+0000 7f709ede2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709815bef0 con 0x7f709806bb90 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.504+0000 7f709ede2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709815b650 con 0x7f70980c99f0 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.504+0000 7f709ede2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f709815f510 con 0x7f709806bf70 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.505+0000 7f7097fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f709806bf70 0x7f709815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.505+0000 7f709cb7e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f709806bb90 0x7f709815ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58642/0 (socket says 172.21.15.26:58642) 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.505+0000 7f709cb7e640 1 -- 172.21.15.26:0/4031279987 learned_addr learned my addr 172.21.15.26:0/4031279987 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.505+0000 7f7097fff640 1 -- 172.21.15.26:0/4031279987 >> v1:172.21.15.169:6789/0 conn(0x7f70980c99f0 legacy=0x7f7098154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.505+0000 7f7097fff640 1 -- 172.21.15.26:0/4031279987 >> v1:172.21.15.26:6789/0 conn(0x7f709806bb90 legacy=0x7f709815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.505+0000 7f7097fff640 1 -- 172.21.15.26:0/4031279987 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709815b930 con 0x7f709806bf70 2024-04-25T13:16:43.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.505+0000 7f70977fe640 1 -- 172.21.15.26:0/4031279987 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014774542 0 0) 0x7f709815bef0 con 0x7f709806bb90 2024-04-25T13:16:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f7097fff640 1 --2- 172.21.15.26:0/4031279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bf70 0x7f709815af70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70840097a0 tx=0x7f708402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9796e9cf8b472b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f70977fe640 1 -- 172.21.15.26:0/4031279987 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084037070 con 0x7f709806bf70 2024-04-25T13:16:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f70977fe640 1 -- 172.21.15.26:0/4031279987 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7084032640 con 0x7f709806bf70 2024-04-25T13:16:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f70977fe640 1 -- 172.21.15.26:0/4031279987 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084032a10 con 0x7f709806bf70 2024-04-25T13:16:43.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f709ede2640 1 -- 172.21.15.26:0/4031279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bf70 msgr2=0x7f709815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f709ede2640 1 --2- 172.21.15.26:0/4031279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bf70 0x7f709815af70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70840097a0 tx=0x7f708402a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f709ede2640 1 -- 172.21.15.26:0/4031279987 shutdown_connections 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f709ede2640 1 --2- 172.21.15.26:0/4031279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bf70 0x7f709815af70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f709ede2640 1 -- 172.21.15.26:0/4031279987 >> 172.21.15.26:0/4031279987 conn(0x7f7098074d50 msgr2=0x7f7098075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f709ede2640 1 -- 172.21.15.26:0/4031279987 shutdown_connections 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.506+0000 7f709ede2640 1 -- 172.21.15.26:0/4031279987 wait complete. 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.507+0000 7f709ede2640 1 Processor -- start 2024-04-25T13:16:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709ede2640 1 -- start start 2024-04-25T13:16:43.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709ede2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bb90 0x7f7098148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709ede2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f709806bf70 0x7f709814a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709ede2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70980c99f0 0x7f70981f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709ede2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f709815e8e0 con 0x7f709806bb90 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709ede2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f709815e600 con 0x7f70980c99f0 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709ede2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7098074560 con 0x7f709806bf70 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709cb7e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bb90 0x7f7098148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.508+0000 7f709cb7e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bb90 0x7f7098148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37030/0 (socket says 172.21.15.26:37030) 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709cb7e640 1 -- 172.21.15.26:0/2365334123 learned_addr learned my addr 172.21.15.26:0/2365334123 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709d37f640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70980c99f0 0x7f70981f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f7097fff640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f709806bf70 0x7f709814a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709cb7e640 1 -- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f709806bf70 msgr2=0x7f709814a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709cb7e640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f709806bf70 0x7f709814a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709cb7e640 1 -- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70980c99f0 msgr2=0x7f70981f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709cb7e640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70980c99f0 0x7f70981f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709cb7e640 1 -- 172.21.15.26:0/2365334123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70980cee10 con 0x7f709806bb90 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f7097fff640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f709806bf70 0x7f709814a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709cb7e640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bb90 0x7f7098148730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c3f0 tx=0x7f708c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f70957fa640 1 -- 172.21.15.26:0/2365334123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c0074e0 con 0x7f709806bb90 2024-04-25T13:16:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f70957fa640 1 -- 172.21.15.26:0/2365334123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c0047e0 con 0x7f709806bb90 2024-04-25T13:16:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709815a980 con 0x7f709806bb90 2024-04-25T13:16:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f70957fa640 1 -- 172.21.15.26:0/2365334123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c004c10 con 0x7f709806bb90 2024-04-25T13:16:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.509+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70981f0670 con 0x7f709806bb90 2024-04-25T13:16:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.510+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7098068e40 con 0x7f709806bb90 2024-04-25T13:16:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.511+0000 7f70957fa640 1 -- 172.21.15.26:0/2365334123 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f708c011070 con 0x7f709806bb90 2024-04-25T13:16:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.511+0000 7f70957fa640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f707c06c8f0 0x7f707c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.511+0000 7f70957fa640 1 -- 172.21.15.26:0/2365334123 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f708c08b920 con 0x7f709806bb90 2024-04-25T13:16:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.511+0000 7f7097fff640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f707c06c8f0 0x7f707c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.512+0000 7f7097fff640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f707c06c8f0 0x7f707c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7084034000 tx=0x7f708402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.515+0000 7f70957fa640 1 -- 172.21.15.26:0/2365334123 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f708c059aa0 con 0x7f709806bb90 2024-04-25T13:16:43.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.703+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7098155410 con 0x7f709806bb90 2024-04-25T13:16:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.704+0000 7f70957fa640 1 -- 172.21.15.26:0/2365334123 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18526 (secure 0 0 0) 0x7f708c0593a0 con 0x7f709806bb90 2024-04-25T13:16:43.705 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:43.705 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:14.615131+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f707c06c8f0 msgr2=0x7f707c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f707c06c8f0 0x7f707c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7084034000 tx=0x7f708402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bb90 msgr2=0x7f7098148730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bb90 0x7f7098148730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c3f0 tx=0x7f708c00c8b0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 shutdown_connections 2024-04-25T13:16:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f707c06c8f0 0x7f707c06edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70980c99f0 0x7f70981f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f709806bf70 0x7f709814a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 --2- 172.21.15.26:0/2365334123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f709806bb90 0x7f7098148730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 >> 172.21.15.26:0/2365334123 conn(0x7f7098074d50 msgr2=0x7f70980737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 shutdown_connections 2024-04-25T13:16:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.706+0000 7f709ede2640 1 -- 172.21.15.26:0/2365334123 wait complete. 2024-04-25T13:16:43.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T13:16:43.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T13:16:43.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T13:16:43.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T13:16:43.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T13:16:43.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T13:16:43.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T13:16:43.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T13:16:43.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.894+0000 7f11b1c79640 1 Processor -- start 2024-04-25T13:16:43.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.895+0000 7f11b1c79640 1 -- start start 2024-04-25T13:16:43.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.895+0000 7fb5d88fd640 1 Processor -- start 2024-04-25T13:16:43.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.895+0000 7f6532aae640 1 Processor -- start 2024-04-25T13:16:43.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.895+0000 7f6532aae640 1 -- start start 2024-04-25T13:16:43.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.895+0000 7fb5d88fd640 1 -- start start 2024-04-25T13:16:43.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11b1c79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11ac06e850 0x7f11ac06f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11b1c79640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f11ac159920 0x7f11ac0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11b1c79640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11ac15f6e0 con 0x7f11ac06ec30 2024-04-25T13:16:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11b1c79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f11ac0c48b0 con 0x7f11ac06e850 2024-04-25T13:16:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11b1c79640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f11ac15f9a0 con 0x7f11ac159920 2024-04-25T13:16:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f556759e640 1 Processor -- start 2024-04-25T13:16:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f556759e640 1 -- start start 2024-04-25T13:16:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7ff75fe0b640 1 Processor -- start 2024-04-25T13:16:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7fc63dfad640 1 Processor -- start 2024-04-25T13:16:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7fc63dfad640 1 -- start start 2024-04-25T13:16:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d88fd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5cc0dd760 0x7fb5cc04e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d88fd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb5cc007e40 0x7fb5cc04d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d88fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc04cd10 0x7fb5cc04dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d88fd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb5cc04eb40 con 0x7fb5cc0dd760 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d88fd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb5cc04e860 con 0x7fb5cc007e40 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d88fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb5cc008670 con 0x7fb5cc04cd10 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5cc0dd760 0x7fb5cc04e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d259c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5cc0dd760 0x7fb5cc04e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51958/0 (socket says 172.21.15.26:51958) 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d259c640 1 -- 172.21.15.26:0/979943199 learned_addr learned my addr 172.21.15.26:0/979943199 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7f6532aae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f652c1510b0 0x7f652c074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7f6532aae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c075290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11ab7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11ac06e850 0x7f11ac06f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11aaffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f11ac06ec30 0x7f11ac159210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42494/0 (socket says 172.21.15.26:42494) 2024-04-25T13:16:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11ab7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11ac06e850 0x7f11ac06f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51956/0 (socket says 172.21.15.26:51956) 2024-04-25T13:16:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7f11aaffd640 1 -- 172.21.15.26:0/3546329625 learned_addr learned my addr 172.21.15.26:0/3546329625 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7f11abfff640 1 --2- 172.21.15.26:0/3546329625 >> v2:172.21.15.169:3300/0 conn(0x7f11ac159920 0x7f11ac0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7f89848a6640 1 Processor -- start 2024-04-25T13:16:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7f89848a6640 1 -- start start 2024-04-25T13:16:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d2d9d640 1 --2- 172.21.15.26:0/979943199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc04cd10 0x7fb5cc04dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7f653104b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f652c0759a0 0x7f652c15a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42502/0 (socket says 172.21.15.26:42502) 2024-04-25T13:16:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d259c640 1 -- 172.21.15.26:0/979943199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc04cd10 msgr2=0x7fb5cc04dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.897+0000 7fb5d259c640 1 --2- 172.21.15.26:0/979943199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc04cd10 0x7fb5cc04dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fb5d259c640 1 -- 172.21.15.26:0/979943199 >> v2:172.21.15.169:3300/0 conn(0x7fb5cc007e40 msgr2=0x7fb5cc04d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fb5d1d9b640 1 --2- 172.21.15.26:0/979943199 >> v2:172.21.15.169:3300/0 conn(0x7fb5cc007e40 0x7fb5cc04d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f653104b640 1 -- 172.21.15.26:0/290175648 learned_addr learned my addr 172.21.15.26:0/290175648 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fb5d259c640 1 --2- 172.21.15.26:0/979943199 >> v2:172.21.15.169:3300/0 conn(0x7fb5cc007e40 0x7fb5cc04d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fb5d259c640 1 -- 172.21.15.26:0/979943199 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc008950 con 0x7fb5cc0dd760 2024-04-25T13:16:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f11abfff640 1 -- 172.21.15.26:0/3546329625 >> v2:172.21.15.26:3300/0 conn(0x7f11ac06e850 msgr2=0x7f11ac06f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c0cbcb0 con 0x7f652c0759a0 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f653084a640 1 --2- 172.21.15.26:0/290175648 >> v2:172.21.15.169:3300/0 conn(0x7f652c1510b0 0x7f652c074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f556759e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f556004cab0 0x7f556004cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f556759e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556000ede0 con 0x7f5560050760 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f556759e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556004d440 con 0x7f55600dd660 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f556759e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f55600dda40 con 0x7f556004cab0 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f556659c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f55600dd660 0x7f55600e3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42512/0 (socket says 172.21.15.26:42512) 2024-04-25T13:16:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f556659c640 1 -- 172.21.15.26:0/174280978 learned_addr learned my addr 172.21.15.26:0/174280978 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fc63dfad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc63806e850 0x7fc63806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fc63dfad640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc63806ec30 0x7fc638159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fc63dfad640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63815f6e0 con 0x7fc6380c4310 2024-04-25T13:16:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fc63dfad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc6380c48b0 con 0x7fc63806e850 2024-04-25T13:16:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fc63dfad640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc63815f9a0 con 0x7fc63806ec30 2024-04-25T13:16:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f652c157920 con 0x7f652c1510b0 2024-04-25T13:16:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f652bfff640 1 --2- 172.21.15.26:0/290175648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.896+0000 7ff75fe0b640 1 -- start start 2024-04-25T13:16:43.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7ff75fe0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c72e0 0x7ff7580c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7ff75fe0b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7580c3e40 0x7ff7580c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7ff75fe0b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff758163790 con 0x7ff7581593c0 2024-04-25T13:16:43.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f652b7fe640 1 -- 172.21.15.26:0/290175648 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708253918 0 0) 0x7f652c0cbcb0 con 0x7f652c0759a0 2024-04-25T13:16:43.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7ff75fe0b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff758162c10 con 0x7ff7580c3e40 2024-04-25T13:16:43.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7ff75fe0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff758162ef0 con 0x7ff7580c72e0 2024-04-25T13:16:43.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f11abfff640 1 --2- 172.21.15.26:0/3546329625 >> v2:172.21.15.26:3300/0 conn(0x7f11ac06e850 0x7f11ac06f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f11abfff640 1 -- 172.21.15.26:0/3546329625 >> v1:172.21.15.169:6789/0 conn(0x7f11ac06ec30 legacy=0x7f11ac159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f652c157c00 con 0x7f652c06c9b0 2024-04-25T13:16:43.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f11abfff640 1 -- 172.21.15.26:0/3546329625 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac15fc80 con 0x7f11ac159920 2024-04-25T13:16:43.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f11ab7fe640 1 --2- 172.21.15.26:0/3546329625 >> v2:172.21.15.26:3300/0 conn(0x7f11ac06e850 0x7f11ac06f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:43.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f5566d9d640 1 --2- 172.21.15.26:0/174280978 >> v2:172.21.15.26:3300/0 conn(0x7f556004cab0 0x7f556004cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f652b7fe640 1 -- 172.21.15.26:0/290175648 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f651c003520 con 0x7f652c0759a0 2024-04-25T13:16:43.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f89848a6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8980155240 0x7f89800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f89848a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f898015ee00 0x7f89800cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f2804442640 1 Processor -- start 2024-04-25T13:16:43.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f89848a6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8980155620 con 0x7f89800cdb10 2024-04-25T13:16:43.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f89848a6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f898015f200 con 0x7f8980155240 2024-04-25T13:16:43.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7f89848a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f898015ae80 con 0x7f898015ee00 2024-04-25T13:16:43.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f2804442640 1 -- start start 2024-04-25T13:16:43.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f898015ee00 0x7f89800cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7ff75d3a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c72e0 0x7ff7580c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7ff75e3a8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7580c3e40 0x7ff7580c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7ff75d3a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c72e0 0x7ff7580c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58576/0 (socket says 172.21.15.26:58576) 2024-04-25T13:16:43.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7ff75d3a6640 1 -- 172.21.15.26:0/1000863480 learned_addr learned my addr 172.21.15.26:0/1000863480 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f898015ee00 0x7f89800cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58578/0 (socket says 172.21.15.26:58578) 2024-04-25T13:16:43.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8980155240 0x7f89800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897effd640 1 -- 172.21.15.26:0/3713749838 learned_addr learned my addr 172.21.15.26:0/3713749838 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7fc637fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc6380c4310 0x7fc6380c4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42524/0 (socket says 172.21.15.26:42524) 2024-04-25T13:16:43.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f652bfff640 1 -- 172.21.15.26:0/290175648 >> v2:172.21.15.169:3300/0 conn(0x7f652c1510b0 msgr2=0x7f652c074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f652bfff640 1 --2- 172.21.15.26:0/290175648 >> v2:172.21.15.169:3300/0 conn(0x7f652c1510b0 0x7f652c074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f652bfff640 1 -- 172.21.15.26:0/290175648 >> v1:172.21.15.169:6789/0 conn(0x7f652c0759a0 legacy=0x7f652c15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f556559a640 1 -- 172.21.15.26:0/174280978 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545383601 0 0) 0x7f556004d440 con 0x7f55600dd660 2024-04-25T13:16:43.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f556559a640 1 -- 172.21.15.26:0/174280978 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5550003520 con 0x7f55600dd660 2024-04-25T13:16:43.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f652bfff640 1 -- 172.21.15.26:0/290175648 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c071510 con 0x7f652c06c9b0 2024-04-25T13:16:43.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7fc637fff640 1 -- 172.21.15.26:0/1158402702 learned_addr learned my addr 172.21.15.26:0/1158402702 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:43.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.898+0000 7fc636ffd640 1 --2- 172.21.15.26:0/1158402702 >> v2:172.21.15.169:3300/0 conn(0x7fc63806ec30 0x7fc638159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897f7fe640 1 -- 172.21.15.26:0/3713749838 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f898015ee00 msgr2=0x7f89800cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7fc6377fe640 1 --2- 172.21.15.26:0/1158402702 >> v2:172.21.15.26:3300/0 conn(0x7fc63806e850 0x7fc63806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7fc636ffd640 1 -- 172.21.15.26:0/1158402702 >> v2:172.21.15.26:3300/0 conn(0x7fc63806e850 msgr2=0x7fc63806f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7fc636ffd640 1 --2- 172.21.15.26:0/1158402702 >> v2:172.21.15.26:3300/0 conn(0x7fc63806e850 0x7fc63806f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7fc636ffd640 1 -- 172.21.15.26:0/1158402702 >> v1:172.21.15.169:6789/0 conn(0x7fc6380c4310 legacy=0x7fc6380c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7fc636ffd640 1 -- 172.21.15.26:0/1158402702 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63815fc80 con 0x7fc63806ec30 2024-04-25T13:16:43.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897f7fe640 1 --2- 172.21.15.26:0/3713749838 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f898015ee00 0x7f89800cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897f7fe640 1 -- 172.21.15.26:0/3713749838 >> v1:172.21.15.26:6789/0 conn(0x7f89800cdb10 legacy=0x7f898015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7f897f7fe640 1 -- 172.21.15.26:0/3713749838 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898015b140 con 0x7f8980155240 2024-04-25T13:16:43.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7ff75d3a6640 1 -- 172.21.15.26:0/1000863480 >> v2:172.21.15.26:3300/0 conn(0x7ff7580c3e40 msgr2=0x7ff7580c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7ff75d3a6640 1 --2- 172.21.15.26:0/1000863480 >> v2:172.21.15.26:3300/0 conn(0x7ff7580c3e40 0x7ff7580c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7ff75d3a6640 1 -- 172.21.15.26:0/1000863480 >> v1:172.21.15.169:6789/0 conn(0x7ff7581593c0 legacy=0x7ff75815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.899+0000 7ff75d3a6640 1 -- 172.21.15.26:0/1000863480 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7581631d0 con 0x7ff7580c72e0 2024-04-25T13:16:43.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.900+0000 7fb5d1d9b640 1 --2- 172.21.15.26:0/979943199 >> v2:172.21.15.169:3300/0 conn(0x7fb5cc007e40 0x7fb5cc04d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:43.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.900+0000 7f652bfff640 1 --2- 172.21.15.26:0/290175648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c075290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65180097a0 tx=0x7f651802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b3501e3dd72864 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.900+0000 7f5566d9d640 1 -- 172.21.15.26:0/174280978 >> v1:172.21.15.169:6789/0 conn(0x7f55600dd660 legacy=0x7f55600e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.900+0000 7f5566d9d640 1 -- 172.21.15.26:0/174280978 >> v1:172.21.15.26:6789/0 conn(0x7f5560050760 legacy=0x7f55600071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.900+0000 7f5566d9d640 1 -- 172.21.15.26:0/174280978 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556004f1a0 con 0x7f556004cab0 2024-04-25T13:16:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.900+0000 7ff75d3a6640 1 --2- 172.21.15.26:0/1000863480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c72e0 0x7ff7580c3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff750009e50 tx=0x7ff75002a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2407443024f88e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f2804442640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27fc06f4a0 0x7f27fc157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f11abfff640 1 --2- 172.21.15.26:0/3546329625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac159920 0x7f11ac0c4d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f11ac06c410 tx=0x7f119c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59fe4be6a45a88af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7fc636ffd640 1 --2- 172.21.15.26:0/1158402702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc63806ec30 0x7fc638159210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6380c4a30 tx=0x7fc62802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75e75a5f7820bf4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f28021de640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f27fc1510b0 0x7f27fc0c3b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42548/0 (socket says 172.21.15.26:42548) 2024-04-25T13:16:43.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f2804442640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27fc06f230 con 0x7f27fc151490 2024-04-25T13:16:43.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f652b7fe640 1 -- 172.21.15.26:0/290175648 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518037070 con 0x7f652c06c9b0 2024-04-25T13:16:43.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f897f7fe640 1 --2- 172.21.15.26:0/3713749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 0x7f89800754a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89780097a0 tx=0x7f897802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b89aac4a8361a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f2804442640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27fc0c7140 con 0x7f27fc1510b0 2024-04-25T13:16:43.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f2804442640 1 -- 172.21.15.26:0/515655736 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f27fc0c7420 con 0x7f27fc06f4a0 2024-04-25T13:16:43.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f28021de640 1 -- 172.21.15.26:0/515655736 learned_addr learned my addr 172.21.15.26:0/515655736 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:43.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7ff75cba5640 1 -- 172.21.15.26:0/1000863480 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff750036070 con 0x7ff7580c72e0 2024-04-25T13:16:43.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f652b7fe640 1 -- 172.21.15.26:0/290175648 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6518032440 con 0x7f652c06c9b0 2024-04-25T13:16:43.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f652b7fe640 1 -- 172.21.15.26:0/290175648 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180327f0 con 0x7f652c06c9b0 2024-04-25T13:16:43.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.900+0000 7fb5d259c640 1 --2- 172.21.15.26:0/979943199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc0dd760 0x7fb5cc04e1b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4064fa0 tx=0x7fb5d40a67b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795c5f51597c06ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7fc6367fc640 1 -- 172.21.15.26:0/1158402702 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628007740 con 0x7fc63806ec30 2024-04-25T13:16:43.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7fc6367fc640 1 -- 172.21.15.26:0/1158402702 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6280078e0 con 0x7fc63806ec30 2024-04-25T13:16:43.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7fc6367fc640 1 -- 172.21.15.26:0/1158402702 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628007cb0 con 0x7fc63806ec30 2024-04-25T13:16:43.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7fb5d159a640 1 -- 172.21.15.26:0/979943199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40ab7d0 con 0x7fb5cc0dd760 2024-04-25T13:16:43.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7fb5d159a640 1 -- 172.21.15.26:0/979943199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d40ab970 con 0x7fb5cc0dd760 2024-04-25T13:16:43.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7fb5d159a640 1 -- 172.21.15.26:0/979943199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40abda0 con 0x7fb5cc0dd760 2024-04-25T13:16:43.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f5566d9d640 1 --2- 172.21.15.26:0/174280978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f556004cab0 0x7f556004cf00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f556802db50 tx=0x7f55680a68e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3fad7ade30e7eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7ff75cba5640 1 -- 172.21.15.26:0/1000863480 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff750031600 con 0x7ff7580c72e0 2024-04-25T13:16:43.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7ff75cba5640 1 -- 172.21.15.26:0/1000863480 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500319d0 con 0x7ff7580c72e0 2024-04-25T13:16:43.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f897e7fc640 1 -- 172.21.15.26:0/3713749838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978037070 con 0x7f8980155240 2024-04-25T13:16:43.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28029df640 1 --2- 172.21.15.26:0/515655736 >> v2:172.21.15.26:3300/0 conn(0x7f27fc06f4a0 0x7f27fc157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f897e7fc640 1 -- 172.21.15.26:0/3713749838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897802ae40 con 0x7f8980155240 2024-04-25T13:16:43.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f556559a640 1 -- 172.21.15.26:0/174280978 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55680a9070 con 0x7f556004cab0 2024-04-25T13:16:43.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 msgr2=0x7f652c075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.901+0000 7f11aa7fc640 1 -- 172.21.15.26:0/3546329625 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c037070 con 0x7f11ac159920 2024-04-25T13:16:43.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f11aa7fc640 1 -- 172.21.15.26:0/3546329625 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c02adc0 con 0x7f11ac159920 2024-04-25T13:16:43.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f11aa7fc640 1 -- 172.21.15.26:0/3546329625 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c037070 con 0x7f11ac159920 2024-04-25T13:16:43.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f556559a640 1 -- 172.21.15.26:0/174280978 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55680ac6a0 con 0x7f556004cab0 2024-04-25T13:16:43.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f6532aae640 1 --2- 172.21.15.26:0/290175648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c075290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65180097a0 tx=0x7f651802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:43.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f556559a640 1 -- 172.21.15.26:0/174280978 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55680acb10 con 0x7f556004cab0 2024-04-25T13:16:43.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7ff75fe0b640 1 -- 172.21.15.26:0/1000863480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c72e0 msgr2=0x7ff7580c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7ff75fe0b640 1 --2- 172.21.15.26:0/1000863480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c72e0 0x7ff7580c3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff750009e50 tx=0x7ff75002a7a0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461001106 0 0) 0x7f27fc06f230 con 0x7f27fc151490 2024-04-25T13:16:43.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e8003520 con 0x7f27fc151490 2024-04-25T13:16:43.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fb5d88fd640 1 -- 172.21.15.26:0/979943199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc0dd760 msgr2=0x7fb5cc04e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fb5d88fd640 1 --2- 172.21.15.26:0/979943199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc0dd760 0x7fb5cc04e1b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4064fa0 tx=0x7fb5d40a67b0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fb5d88fd640 1 -- 172.21.15.26:0/979943199 shutdown_connections 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fb5d88fd640 1 --2- 172.21.15.26:0/979943199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc04cd10 0x7fb5cc04dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fb5d88fd640 1 --2- 172.21.15.26:0/979943199 >> v2:172.21.15.169:3300/0 conn(0x7fb5cc007e40 0x7fb5cc04d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fb5d88fd640 1 --2- 172.21.15.26:0/979943199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc0dd760 0x7fb5cc04e1b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fb5d88fd640 1 -- 172.21.15.26:0/979943199 >> 172.21.15.26:0/979943199 conn(0x7fb5cc00e690 msgr2=0x7fb5cc009d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372883409 0 0) 0x7f27fc0c7140 con 0x7f27fc1510b0 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27fc06f230 con 0x7f27fc1510b0 2024-04-25T13:16:43.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1254933143 0 0) 0x7f27e8003520 con 0x7f27fc151490 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 >> v2:172.21.15.26:3300/0 conn(0x7f27fc06f4a0 msgr2=0x7f27fc157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 --2- 172.21.15.26:0/515655736 >> v2:172.21.15.26:3300/0 conn(0x7f27fc06f4a0 0x7f27fc157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 >> v1:172.21.15.169:6789/0 conn(0x7f27fc1510b0 legacy=0x7f27fc0c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 -- 172.21.15.26:0/1158402702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc63806ec30 msgr2=0x7fc638159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 --2- 172.21.15.26:0/1158402702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc63806ec30 0x7fc638159210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6380c4a30 tx=0x7fc62802a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 -- 172.21.15.26:0/1158402702 shutdown_connections 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 --2- 172.21.15.26:0/1158402702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc63806ec30 0x7fc638159210 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6380c4a30 tx=0x7fc62802a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f897e7fc640 1 -- 172.21.15.26:0/3713749838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978032660 con 0x7f8980155240 2024-04-25T13:16:43.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 --2- 172.21.15.26:0/1158402702 >> v2:172.21.15.26:3300/0 conn(0x7fc63806e850 0x7fc63806f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 -- 172.21.15.26:0/1158402702 >> 172.21.15.26:0/1158402702 conn(0x7fc6380c8f00 msgr2=0x7fc6380c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc0c7700 con 0x7f27fc151490 2024-04-25T13:16:43.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 shutdown_connections 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f27ec001690 con 0x7f27fc151490 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 >> v1:172.21.15.26:6789/0 conn(0x7f27fc151490 legacy=0x7f27fc06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e8004ba0 0x7f27e8004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27e8004160 0x7f27e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc0c7420 con 0x7f27e8004ba0 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27e800c0f0 con 0x7f27e80037a0 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27e800c2f0 con 0x7f27e8004160 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 -- 172.21.15.26:0/3546329625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac159920 msgr2=0x7f11ac0c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 --2- 172.21.15.26:0/3546329625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac159920 0x7f11ac0c4d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f11ac06c410 tx=0x7f119c02a130 comp rx=0 tx=0).stop 2024-04-25T13:16:43.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f6532aae640 1 --2- 172.21.15.26:0/290175648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c075290 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 -- 172.21.15.26:0/3546329625 shutdown_connections 2024-04-25T13:16:43.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 --2- 172.21.15.26:0/3546329625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac159920 0x7f11ac0c4d40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 --2- 172.21.15.26:0/3546329625 >> v2:172.21.15.26:3300/0 conn(0x7f11ac06e850 0x7f11ac06f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 -- 172.21.15.26:0/3713749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 msgr2=0x7f89800754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 --2- 172.21.15.26:0/3713749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 0x7f89800754a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89780097a0 tx=0x7f897802a0f0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 -- 172.21.15.26:0/3546329625 >> 172.21.15.26:0/3546329625 conn(0x7f11ac0c8f00 msgr2=0x7f11ac0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28029df640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27e8004160 0x7f27e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 -- 172.21.15.26:0/1158402702 shutdown_connections 2024-04-25T13:16:43.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.902+0000 7fc63dfad640 1 -- 172.21.15.26:0/1158402702 wait complete. 2024-04-25T13:16:43.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7ff75fe0b640 1 -- 172.21.15.26:0/1000863480 shutdown_connections 2024-04-25T13:16:43.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7ff75fe0b640 1 --2- 172.21.15.26:0/1000863480 >> v2:172.21.15.26:3300/0 conn(0x7ff7580c3e40 0x7ff7580c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7ff75fe0b640 1 --2- 172.21.15.26:0/1000863480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c72e0 0x7ff7580c3900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7ff75fe0b640 1 -- 172.21.15.26:0/1000863480 >> 172.21.15.26:0/1000863480 conn(0x7ff75806eb20 msgr2=0x7ff75806ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7ff75fe0b640 1 -- 172.21.15.26:0/1000863480 shutdown_connections 2024-04-25T13:16:43.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f6532aae640 1 --2- 172.21.15.26:0/290175648 >> v2:172.21.15.169:3300/0 conn(0x7f652c1510b0 0x7f652c074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 >> 172.21.15.26:0/290175648 conn(0x7f652c0c8cf0 msgr2=0x7f652c0c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 -- 172.21.15.26:0/3713749838 shutdown_connections 2024-04-25T13:16:43.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 --2- 172.21.15.26:0/3713749838 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f898015ee00 0x7f89800cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 --2- 172.21.15.26:0/3713749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 0x7f89800754a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 -- 172.21.15.26:0/3713749838 >> 172.21.15.26:0/3713749838 conn(0x7f898006fd40 msgr2=0x7f8980070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28019dd640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28021de640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e8004ba0 0x7f27e8004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 shutdown_connections 2024-04-25T13:16:43.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f556759e640 1 -- 172.21.15.26:0/174280978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f556004cab0 msgr2=0x7f556004cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f556759e640 1 --2- 172.21.15.26:0/174280978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f556004cab0 0x7f556004cf00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f556802db50 tx=0x7f55680a68e0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 -- 172.21.15.26:0/3713749838 shutdown_connections 2024-04-25T13:16:43.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f6532aae640 1 -- 172.21.15.26:0/290175648 wait complete. 2024-04-25T13:16:43.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f89848a6640 1 -- 172.21.15.26:0/3713749838 wait complete. 2024-04-25T13:16:43.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f556759e640 1 -- 172.21.15.26:0/174280978 shutdown_connections 2024-04-25T13:16:43.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f556759e640 1 --2- 172.21.15.26:0/174280978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f556004cab0 0x7f556004cf00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f556759e640 1 -- 172.21.15.26:0/174280978 >> 172.21.15.26:0/174280978 conn(0x7f556000e150 msgr2=0x7f556000e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.904+0000 7f556759e640 1 -- 172.21.15.26:0/174280978 shutdown_connections 2024-04-25T13:16:43.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.904+0000 7f556759e640 1 -- 172.21.15.26:0/174280978 wait complete. 2024-04-25T13:16:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7ff75fe0b640 1 -- 172.21.15.26:0/1000863480 wait complete. 2024-04-25T13:16:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.904+0000 7fc63dfad640 1 Processor -- start 2024-04-25T13:16:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 -- 172.21.15.26:0/3546329625 shutdown_connections 2024-04-25T13:16:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f11b1c79640 1 -- 172.21.15.26:0/3546329625 wait complete. 2024-04-25T13:16:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7fc63dfad640 1 -- start start 2024-04-25T13:16:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7fb5d88fd640 1 -- 172.21.15.26:0/979943199 shutdown_connections 2024-04-25T13:16:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7f89848a6640 1 Processor -- start 2024-04-25T13:16:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7fb5d88fd640 1 -- 172.21.15.26:0/979943199 wait complete. 2024-04-25T13:16:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7f89848a6640 1 -- start start 2024-04-25T13:16:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7f11b1c79640 1 Processor -- start 2024-04-25T13:16:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7f6532aae640 1 Processor -- start 2024-04-25T13:16:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28019dd640 1 -- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27e8004160 msgr2=0x7f27e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28019dd640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27e8004160 0x7f27e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28019dd640 1 -- 172.21.15.26:0/515655736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e8004ba0 msgr2=0x7f27e8004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28019dd640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27e8004ba0 0x7f27e8004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.903+0000 7f28019dd640 1 -- 172.21.15.26:0/515655736 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc0c7700 con 0x7f27e80037a0 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.904+0000 7f28029df640 1 -- 172.21.15.26:0/515655736 reap_dead start 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7f28019dd640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27e8003c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27fc06f400 tx=0x7f27e8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4239f83ccf074b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7ff75fe0b640 1 Processor -- start 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7ff75fe0b640 1 -- start start 2024-04-25T13:16:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.905+0000 7f11b1c79640 1 -- start start 2024-04-25T13:16:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f6532aae640 1 -- start start 2024-04-25T13:16:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec036070 con 0x7f27e80037a0 2024-04-25T13:16:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ec02ae50 con 0x7f27e80037a0 2024-04-25T13:16:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f28011dc640 1 -- 172.21.15.26:0/515655736 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec007cc0 con 0x7f27e80037a0 2024-04-25T13:16:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7fc63dfad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc63806e850 0x7fc6381f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f89848a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89800cdb10 0x7f89801557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7fc63dfad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6380c4310 0x7fc638153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f89848a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 0x7f89801f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f556759e640 1 Processor -- start 2024-04-25T13:16:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7fc63dfad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc638071b70 0x7fc6381500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f89848a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898015ee00 0x7f89801489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f89848a6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f898015b9e0 con 0x7f8980155240 2024-04-25T13:16:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f89848a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f898015b700 con 0x7f898015ee00 2024-04-25T13:16:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75fe0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c3e40 0x7ff7580cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f89848a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f898015bcc0 con 0x7f89800cdb10 2024-04-25T13:16:43.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7f556759e640 1 -- start start 2024-04-25T13:16:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7fc63dfad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc63815f3d0 con 0x7fc638071b70 2024-04-25T13:16:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7fc63dfad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc638160240 con 0x7fc6380c4310 2024-04-25T13:16:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7fc63dfad640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc63806f9e0 con 0x7fc63806e850 2024-04-25T13:16:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89800cdb10 0x7f89801557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898015ee00 0x7f89801489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f11b1c79640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac06e850 0x7f11ac1f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89800cdb10 0x7f89801557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58596/0 (socket says 172.21.15.26:58596) 2024-04-25T13:16:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897f7fe640 1 -- 172.21.15.26:0/3922332906 learned_addr learned my addr 172.21.15.26:0/3922332906 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75fe0b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7580c72e0 0x7ff75814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75fe0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7581593c0 0x7ff75814e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75fe0b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff758162810 con 0x7ff7580c72e0 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75fe0b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7580c4650 con 0x7ff7581593c0 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75fe0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff758162990 con 0x7ff7580c3e40 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75e3a8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7581593c0 0x7ff75814e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75e3a8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7581593c0 0x7ff75814e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:36874/0 (socket says 172.21.15.26:36874) 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.906+0000 7ff75e3a8640 1 -- 172.21.15.26:0/4224065231 learned_addr learned my addr 172.21.15.26:0/4224065231 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7ff75d3a6640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7580c72e0 0x7ff75814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f2804442640 1 -- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 msgr2=0x7f27e8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897effd640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 0x7f89801f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f2804442640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27e8003c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27fc06f400 tx=0x7f27e8005830 comp rx=0 tx=0).stop 2024-04-25T13:16:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc638071b70 0x7fc6381500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc638071b70 0x7fc6381500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52036/0 (socket says 172.21.15.26:52036) 2024-04-25T13:16:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 -- 172.21.15.26:0/2835223542 learned_addr learned my addr 172.21.15.26:0/2835223542 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f6532aae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 -- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc63806e850 msgr2=0x7fc6381f5ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:43.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc63806e850 0x7fc6381f5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 -- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6380c4310 msgr2=0x7fc638153580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:43.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc636ffd640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6380c4310 0x7fc638153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f11b1c79640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11ac06ec30 0x7f11ac073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7ff75e3a8640 1 -- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c3e40 msgr2=0x7ff7580cb6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:16:43.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7ff75e3a8640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7580c3e40 0x7ff7580cb6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7ff75e3a8640 1 -- 172.21.15.26:0/4224065231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7580c72e0 msgr2=0x7ff75814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7ff75e3a8640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7580c72e0 0x7ff75814dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f6532aae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0759a0 0x7f652c1f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7ff75e3a8640 1 -- 172.21.15.26:0/4224065231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7580ccd40 con 0x7ff7581593c0 2024-04-25T13:16:43.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f11b1c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11ac159920 0x7f11ac1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6380c4310 0x7fc638153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f6532aae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652c1510b0 0x7f652c1f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7fc637fff640 1 -- 172.21.15.26:0/2835223542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc638153ac0 con 0x7fc638071b70 2024-04-25T13:16:43.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f11b1c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac15f3d0 con 0x7f11ac159920 2024-04-25T13:16:43.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f653084a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f11abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11ac159920 0x7f11ac1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f11abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11ac159920 0x7f11ac1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52054/0 (socket says 172.21.15.26:52054) 2024-04-25T13:16:43.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f653084a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58612/0 (socket says 172.21.15.26:58612) 2024-04-25T13:16:43.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f11abfff640 1 -- 172.21.15.26:0/3427937575 learned_addr learned my addr 172.21.15.26:0/3427937575 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f11b1c79640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac160240 con 0x7f11ac06e850 2024-04-25T13:16:43.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7ff75e3a8640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7581593c0 0x7ff75814e520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff75400e7f0 tx=0x7ff75400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f652bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0759a0 0x7f652c1f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f11b1c79640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f11ac06f9e0 con 0x7f11ac06ec30 2024-04-25T13:16:43.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897ffff640 1 -- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89800cdb10 msgr2=0x7f89801557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897ffff640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89800cdb10 0x7f89801557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897ffff640 1 -- 172.21.15.26:0/3922332906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 msgr2=0x7f89801f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.907+0000 7f897ffff640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8980155240 0x7f89801f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f897ffff640 1 -- 172.21.15.26:0/3922332906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8980158700 con 0x7f898015ee00 2024-04-25T13:16:43.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f652bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0759a0 0x7f652c1f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52050/0 (socket says 172.21.15.26:52050) 2024-04-25T13:16:43.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f11ab7fe640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac06e850 0x7f11ac1f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f11aaffd640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11ac06ec30 0x7f11ac073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f6532aae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f652c151490 con 0x7f652c0759a0 2024-04-25T13:16:43.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f6532aae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f652c071ad0 con 0x7f652c1510b0 2024-04-25T13:16:43.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f556759e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f556004cab0 0x7f55600e4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f6532aae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f652c151610 con 0x7f652c06c9b0 2024-04-25T13:16:43.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f652bfff640 1 -- 172.21.15.26:0/1050080649 learned_addr learned my addr 172.21.15.26:0/1050080649 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f556759e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5560050760 0x7f55600db6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7fb5d88fd640 1 Processor -- start 2024-04-25T13:16:43.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f2804442640 1 -- 172.21.15.26:0/515655736 shutdown_connections 2024-04-25T13:16:43.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f2804442640 1 --2- 172.21.15.26:0/515655736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27e8003c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f2804442640 1 -- 172.21.15.26:0/515655736 >> 172.21.15.26:0/515655736 conn(0x7f27fc0c8f00 msgr2=0x7f27fc0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:43.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754017070 con 0x7ff7581593c0 2024-04-25T13:16:43.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f556659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f556004cab0 0x7f55600e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f556659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f556004cab0 0x7f55600e4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58630/0 (socket says 172.21.15.26:58630) 2024-04-25T13:16:43.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7fc637fff640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc638071b70 0x7fc6381500e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c3f0 tx=0x7fc63000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f2804442640 1 -- 172.21.15.26:0/515655736 shutdown_connections 2024-04-25T13:16:43.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f2804442640 1 -- 172.21.15.26:0/515655736 wait complete. 2024-04-25T13:16:43.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f556659c640 1 -- 172.21.15.26:0/1527475723 learned_addr learned my addr 172.21.15.26:0/1527475723 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f556759e640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600dd660 0x7f55600dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7f897ffff640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898015ee00 0x7f89801489e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f897400c3c0 tx=0x7f897400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630017070 con 0x7fc638071b70 2024-04-25T13:16:43.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc630005ce0 con 0x7fc638071b70 2024-04-25T13:16:43.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f5565d9b640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5560050760 0x7f55600db6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300072f0 con 0x7fc638071b70 2024-04-25T13:16:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc638155290 con 0x7fc638071b70 2024-04-25T13:16:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f11ab7fe640 1 -- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11ac06ec30 msgr2=0x7f11ac073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f11ab7fe640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11ac06ec30 0x7f11ac073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f11ab7fe640 1 -- 172.21.15.26:0/3427937575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11ac159920 msgr2=0x7f11ac1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f11ab7fe640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11ac159920 0x7f11ac1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f11ab7fe640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac0740a0 con 0x7f11ac06e850 2024-04-25T13:16:43.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f653104b640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652c1510b0 0x7f652c1f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f556759e640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f556004fa40 con 0x7f55600dd660 2024-04-25T13:16:43.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f556759e640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f556004f760 con 0x7f5560050760 2024-04-25T13:16:43.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f556759e640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f556004fd20 con 0x7f556004cab0 2024-04-25T13:16:43.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740052d0 con 0x7f898015ee00 2024-04-25T13:16:43.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974005470 con 0x7f898015ee00 2024-04-25T13:16:43.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974007260 con 0x7f898015ee00 2024-04-25T13:16:43.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f11ab7fe640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac06e850 0x7f11ac1f5cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11a000e930 tx=0x7f11a000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f5566d9d640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600dd660 0x7f55600dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7fb5d88fd640 1 -- start start 2024-04-25T13:16:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fb5d88fd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5cc007e40 0x7fb5cc17d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f556659c640 1 -- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5560050760 msgr2=0x7f55600db6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f556659c640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5560050760 0x7f55600db6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7f556659c640 1 -- 172.21.15.26:0/1527475723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600dd660 msgr2=0x7f55600dbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7580cbbf0 con 0x7ff7581593c0 2024-04-25T13:16:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.908+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff758155c50 con 0x7ff7581593c0 2024-04-25T13:16:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75400ee40 con 0x7ff7581593c0 2024-04-25T13:16:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f653104b640 1 -- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 msgr2=0x7f652c145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f653104b640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f652c06c9b0 0x7f652c145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f653104b640 1 -- 172.21.15.26:0/1050080649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0759a0 msgr2=0x7f652c1f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f653104b640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0759a0 0x7f652c1f0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f653104b640 1 -- 172.21.15.26:0/1050080649 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c14cef0 con 0x7f652c1510b0 2024-04-25T13:16:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0017070 con 0x7f11ac06e850 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f11b1c79640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac074380 con 0x7f11ac06e850 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fb5d88fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc04cd10 0x7fb5cc052a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fb5d88fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc0e6d10 0x7fb5cc0d9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fb5d88fd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc0e36b0 con 0x7fb5cc04cd10 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fb5d88fd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc0e3530 con 0x7fb5cc007e40 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.909+0000 7fb5d88fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb5cc0e3830 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7fb5d1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc04cd10 0x7fb5cc052a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7fb5d1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc04cd10 0x7fb5cc052a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52072/0 (socket says 172.21.15.26:52072) 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7fb5d1d9b640 1 -- 172.21.15.26:0/3535057004 learned_addr learned my addr 172.21.15.26:0/3535057004 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7fb5d259c640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5cc007e40 0x7fb5cc17d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7fb5d2d9d640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc0e6d10 0x7fb5cc0d9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f11b1c79640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac1e8080 con 0x7f11ac06e850 2024-04-25T13:16:43.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f89848a6640 1 -- 172.21.15.26:0/3922332906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89801f0e30 con 0x7f898015ee00 2024-04-25T13:16:43.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f89848a6640 1 -- 172.21.15.26:0/3922332906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898014b6e0 con 0x7f898015ee00 2024-04-25T13:16:43.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f2804442640 1 Processor -- start 2024-04-25T13:16:43.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75400cb60 con 0x7ff7581593c0 2024-04-25T13:16:43.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a000ca00 con 0x7f11ac06e850 2024-04-25T13:16:43.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f2804442640 1 -- start start 2024-04-25T13:16:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7fb5d2d9d640 1 -- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5cc007e40 msgr2=0x7fb5cc17d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7fb5d2d9d640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5cc007e40 0x7fb5cc17d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7fb5d2d9d640 1 -- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc04cd10 msgr2=0x7fb5cc052a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7fb5d2d9d640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc04cd10 0x7fb5cc052a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7fb5d2d9d640 1 -- 172.21.15.26:0/3535057004 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc0e7270 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6381eb970 con 0x7fc638071b70 2024-04-25T13:16:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f556659c640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600dd660 0x7f55600dbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f556659c640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55600df130 con 0x7f556004cab0 2024-04-25T13:16:43.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f5566d9d640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600dd660 0x7f55600dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:43.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7fb5d1d9b640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc04cd10 0x7fb5cc052a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:43.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7fc62dffb640 1 -- 172.21.15.26:0/2835223542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc638068e40 con 0x7fc638071b70 2024-04-25T13:16:43.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f556659c640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f556004cab0 0x7f55600e4780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f555800c390 tx=0x7f555800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8980069310 con 0x7f898015ee00 2024-04-25T13:16:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff740001030 con 0x7ff7581593c0 2024-04-25T13:16:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a000cdd0 con 0x7f11ac06e850 2024-04-25T13:16:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.910+0000 7f653104b640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652c1510b0 0x7f652c1f0570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f652400ca80 tx=0x7f652400cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524017070 con 0x7f652c1510b0 2024-04-25T13:16:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.911+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652400ac30 con 0x7f652c1510b0 2024-04-25T13:16:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558017070 con 0x7f556004cab0 2024-04-25T13:16:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7fb5d2d9d640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc0e6d10 0x7fb5cc0d9520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800e7f0 tx=0x7fb5c800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524012400 con 0x7f652c1510b0 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f6532aae640 1 -- 172.21.15.26:0/1050080649 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c0c86d0 con 0x7f652c1510b0 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f6532aae640 1 -- 172.21.15.26:0/1050080649 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c14b630 con 0x7f652c1510b0 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f11b1c79640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f118c001030 con 0x7f11ac06e850 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f11a001a070 con 0x7f11ac06e850 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f1193fff640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f119806c940 0x7f119806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f2804442640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27fc150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f2804442640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27fc1459c0 0x7f27fc154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f2804442640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27fc145de0 0x7f27fc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f2804442640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc0c7fa0 con 0x7f27fc145de0 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f2804442640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc0c7cc0 con 0x7f27e80037a0 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f2804442640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27fc0c6e00 con 0x7f27fc1459c0 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f28029df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27fc145de0 0x7f27fc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f28029df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27fc145de0 0x7f27fc1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52078/0 (socket says 172.21.15.26:52078) 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f28029df640 1 -- 172.21.15.26:0/2213596841 learned_addr learned my addr 172.21.15.26:0/2213596841 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f28019dd640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27fc1459c0 0x7f27fc154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f28021de640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27fc150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f28019dd640 1 -- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 msgr2=0x7f27fc150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f28019dd640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27e80037a0 0x7f27fc150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f28019dd640 1 -- 172.21.15.26:0/2213596841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27fc145de0 msgr2=0x7f27fc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f28019dd640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27fc145de0 0x7f27fc1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:43.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f28019dd640 1 -- 172.21.15.26:0/2213596841 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc1667a0 con 0x7f27fc1459c0 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5558005ce0 con 0x7f556004cab0 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55580072f0 con 0x7f556004cab0 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.912+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc63001a070 con 0x7fc638071b70 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fc62ffff640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc61806c920 0x7fc61806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc63008b130 con 0x7fc638071b70 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fc62ffff640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7fc618076090 0x7fc6180784d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 --> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc630013e50 con 0x7fc618076090 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc630092050 con 0x7fc638071b70 2024-04-25T13:16:43.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fc6377fe640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc61806c920 0x7fc61806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f11a008bfe0 con 0x7f11ac06e850 2024-04-25T13:16:43.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff75401a070 con 0x7ff7581593c0 2024-04-25T13:16:43.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fc636ffd640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7fc618076090 0x7fc6180784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8974007400 con 0x7f898015ee00 2024-04-25T13:16:43.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8017070 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f556759e640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55600e0490 con 0x7f556004cab0 2024-04-25T13:16:43.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f1193fff640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7f11980760b0 0x7f11980784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11a001de50 con 0x7f11980760b0 2024-04-25T13:16:43.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f11a008e600 con 0x7f11ac06e850 2024-04-25T13:16:43.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f11aaffd640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f119806c940 0x7f119806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7f28019dd640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27fc1459c0 0x7f27fc154fa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c2c0 tx=0x7f27ec001990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f556759e640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55600dac00 con 0x7f556004cab0 2024-04-25T13:16:43.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7ff74e7fc640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff73c06c940 0x7ff73c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f11abfff640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7f11980760b0 0x7f11980784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f8967fff640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f896c06c970 0x7f896c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff75408be50 con 0x7ff7581593c0 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f897408b090 con 0x7f898015ee00 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f8967fff640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7f896c0760e0 0x7f896c078520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 --> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f896c078bf0 con 0x7f896c0760e0 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8974092050 con 0x7f898015ee00 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7ff74e7fc640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7ff73c0760b0 0x7ff73c0784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 --> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff754006870 con 0x7ff73c0760b0 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff75408c200 con 0x7ff7581593c0 2024-04-25T13:16:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7ff75dba7640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff73c06c940 0x7ff73c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.913+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc0e7550 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc179950 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c800c940 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f11abfff640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7f11980760b0 0x7f11980784f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f897f7fe640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f896c06c970 0x7f896c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800cd10 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec040020 con 0x7f27fc1459c0 2024-04-25T13:16:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc166500 con 0x7f27fc1459c0 2024-04-25T13:16:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc0c2cc0 con 0x7f27fc1459c0 2024-04-25T13:16:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ec005290 con 0x7f27fc1459c0 2024-04-25T13:16:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec036040 con 0x7f27fc1459c0 2024-04-25T13:16:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.914+0000 7fc636ffd640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7fc618076090 0x7fc6180784d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5b8001030 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7f897effd640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7f896c0760e0 0x7f896c078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7f6532aae640 1 -- 172.21.15.26:0/1050080649 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f652c068cc0 con 0x7f652c1510b0 2024-04-25T13:16:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== osd.2 v2:172.21.15.26:6808/1245488833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11a001de50 con 0x7f11980760b0 2024-04-25T13:16:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7f556759e640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f556000eff0 con 0x7f556004cab0 2024-04-25T13:16:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7f897f7fe640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f896c06c970 0x7f896c06ee30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8978009560 tx=0x7f897802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7ff75d3a6640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7ff73c0760b0 0x7ff73c0784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7fc6377fe640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc61806c920 0x7fc61806ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc620009870 tx=0x7fc620008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.915+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== osd.7 v2:172.21.15.169:6801/3191394862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc630013e50 con 0x7fc618076090 2024-04-25T13:16:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.916+0000 7f11aaffd640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f119806c940 0x7f119806ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11ac06f120 tx=0x7f11a4001850 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.916+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27e4001030 con 0x7f27fc1459c0 2024-04-25T13:16:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.916+0000 7f897effd640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7f896c0760e0 0x7f896c078520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.916+0000 7ff75d3a6640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7ff73c0760b0 0x7ff73c0784f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.916+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f652401a070 con 0x7f652c1510b0 2024-04-25T13:16:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.916+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f555801a070 con 0x7f556004cab0 2024-04-25T13:16:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f65297fa640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f651006c9f0 0x7f651006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.916+0000 7ff75dba7640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff73c06c940 0x7ff73c06ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff748000f60 tx=0x7ff7480079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f652408bc30 con 0x7f652c1510b0 2024-04-25T13:16:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== osd.6 v2:172.21.15.169:6824/3237270722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff754006870 con 0x7ff73c0760b0 2024-04-25T13:16:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== osd.5 v2:172.21.15.169:6800/1715640241 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f896c078bf0 con 0x7f896c0760e0 2024-04-25T13:16:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f5556ffd640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f554806c9f0 0x7f554806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f65297fa640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7f6510076160 0x7f65100785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 --> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f652401dec0 con 0x7f6510076160 2024-04-25T13:16:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f652408e290 con 0x7f652c1510b0 2024-04-25T13:16:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f5565d9b640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f554806c9f0 0x7f554806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27ec043020 con 0x7f27fc1459c0 2024-04-25T13:16:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f652bfff640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7f6510076160 0x7f65100785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f653084a640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f651006c9f0 0x7f651006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.917+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f555808b240 con 0x7f556004cab0 2024-04-25T13:16:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5c801a070 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f27f2ffd640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f27e006c9c0 0x7f27e006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f27ec0abc60 con 0x7f27fc1459c0 2024-04-25T13:16:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f5565d9b640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f554806c9f0 0x7f554806eeb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f556004af20 tx=0x7f555c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f5556ffd640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f5548076160 0x7f55480785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5558015e70 con 0x7f5548076160 2024-04-25T13:16:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f652bfff640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7f6510076160 0x7f65100785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5558092050 con 0x7f556004cab0 2024-04-25T13:16:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f27f2ffd640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f27e0076130 0x7f27e0078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7fb5c2ffd640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb5b406c9f0 0x7fb5b406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f5566d9d640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f5548076160 0x7f55480785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 --> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27ec035e90 con 0x7f27e0076130 2024-04-25T13:16:43.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.918+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f27ec0ac050 con 0x7f27fc1459c0 2024-04-25T13:16:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb5c808c480 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7fb5d259c640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb5b406c9f0 0x7fb5b406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7fb5c2ffd640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fb5b4076160 0x7fb5b40785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 --> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5c800c940 con 0x7fb5b4076160 2024-04-25T13:16:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb5c808c870 con 0x7fb5cc0e6d10 2024-04-25T13:16:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7f28029df640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f27e0076130 0x7f27e0078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7f28021de640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f27e006c9c0 0x7f27e006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7f653084a640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f651006c9f0 0x7f651006eeb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65200079a0 tx=0x7f6520008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7f5566d9d640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f5548076160 0x7f55480785a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7fb5d1d9b640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fb5b4076160 0x7fb5b40785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.920+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== osd.1 v2:172.21.15.26:6800/1755672510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f652401dec0 con 0x7f6510076160 2024-04-25T13:16:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.919+0000 7f28029df640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f27e0076130 0x7f27e0078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.920+0000 7fb5d259c640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb5b406c9f0 0x7fb5b406eeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00da60 tx=0x7fb5d40ab000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.920+0000 7fb5d1d9b640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fb5b4076160 0x7fb5b40785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.920+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== osd.4 v2:172.21.15.169:6816/1358743323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5558015e70 con 0x7f5548076160 2024-04-25T13:16:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.921+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== osd.3 v2:172.21.15.26:6824/3590411791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27ec035e90 con 0x7f27e0076130 2024-04-25T13:16:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.921+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== osd.0 v2:172.21.15.26:6816/2347346544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5c800c940 con 0x7fb5b4076160 2024-04-25T13:16:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.927+0000 7f28021de640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f27e006c9c0 0x7f27e006ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27f4005fb0 tx=0x7f27f4005f40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:43.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.949+0000 7f11b1c79640 1 -- 172.21.15.26:0/3427937575 --> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f118c002dd0 con 0x7f11980760b0 2024-04-25T13:16:43.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.949+0000 7f1193fff640 1 -- 172.21.15.26:0/3427937575 <== osd.2 v2:172.21.15.26:6808/1245488833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f118c002dd0 con 0x7f11980760b0 2024-04-25T13:16:43.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.949+0000 7fc62dffb640 1 -- 172.21.15.26:0/2835223542 --> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc638159870 con 0x7fc618076090 2024-04-25T13:16:44.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 -- 172.21.15.26:0/3427937575 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7f11980760b0 msgr2=0x7f11980784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7f11980760b0 0x7f11980784f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7fc62ffff640 1 -- 172.21.15.26:0/2835223542 <== osd.7 v2:172.21.15.169:6801/3191394862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc638159870 con 0x7fc618076090 2024-04-25T13:16:44.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 -- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f119806c940 msgr2=0x7f119806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f119806c940 0x7f119806ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11ac06f120 tx=0x7f11a4001850 comp rx=0 tx=0).stop 2024-04-25T13:16:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 -- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac06e850 msgr2=0x7f11ac1f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 --2- 172.21.15.26:0/3427937575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11ac06e850 0x7f11ac1f5cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11a000e930 tx=0x7f11a000edf0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 --> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff740002dd0 con 0x7ff73c0760b0 2024-04-25T13:16:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f11abfff640 1 -- 172.21.15.26:0/3427937575 reap_dead start 2024-04-25T13:16:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 -- 172.21.15.26:0/3427937575 shutdown_connections 2024-04-25T13:16:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f1191ffb640 1 -- 172.21.15.26:0/3427937575 >> 172.21.15.26:0/3427937575 conn(0x7f11ac0c8f00 msgr2=0x7f11ac0c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.950+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 --> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f898014f2c0 con 0x7f896c0760e0 2024-04-25T13:16:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7fc618076090 msgr2=0x7fc6180784d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7fc618076090 0x7fc6180784d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc61806c920 msgr2=0x7fc61806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7ff74e7fc640 1 -- 172.21.15.26:0/4224065231 <== osd.6 v2:172.21.15.169:6824/3237270722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff740002dd0 con 0x7ff73c0760b0 2024-04-25T13:16:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc61806c920 0x7fc61806ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc620009870 tx=0x7fc620008040 comp rx=0 tx=0).stop 2024-04-25T13:16:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7f1191ffb640 1 -- 172.21.15.26:0/3427937575 shutdown_connections 2024-04-25T13:16:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7f1191ffb640 1 -- 172.21.15.26:0/3427937575 wait complete. 2024-04-25T13:16:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc638071b70 msgr2=0x7fc6381500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 --2- 172.21.15.26:0/2835223542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc638071b70 0x7fc6381500e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c3f0 tx=0x7fc63000c8b0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7f8967fff640 1 -- 172.21.15.26:0/3922332906 <== osd.5 v2:172.21.15.169:6800/1715640241 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f898014f2c0 con 0x7f896c0760e0 2024-04-25T13:16:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7ff73c0760b0 msgr2=0x7ff73c0784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7ff75fe0b640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7ff73c0760b0 0x7ff73c0784f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc637fff640 1 -- 172.21.15.26:0/2835223542 reap_dead start 2024-04-25T13:16:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 shutdown_connections 2024-04-25T13:16:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 >> 172.21.15.26:0/2835223542 conn(0x7fc6380c8f00 msgr2=0x7fc6380c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7f896c0760e0 msgr2=0x7f896c078520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7f8965ffb640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7f896c0760e0 0x7f896c078520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f896c06c970 msgr2=0x7f896c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f896c06c970 0x7f896c06ee30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8978009560 tx=0x7f897802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898015ee00 msgr2=0x7f89801489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 --2- 172.21.15.26:0/3922332906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f898015ee00 0x7f89801489e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f897400c3c0 tx=0x7f897400c880 comp rx=0 tx=0).stop 2024-04-25T13:16:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 shutdown_connections 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff73c06c940 msgr2=0x7ff73c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7ff75fe0b640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff73c06c940 0x7ff73c06ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff748000f60 tx=0x7ff7480079b0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7581593c0 msgr2=0x7ff75814e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.951+0000 7ff75fe0b640 1 --2- 172.21.15.26:0/4224065231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7581593c0 0x7ff75814e520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff75400e7f0 tx=0x7ff75400ebf0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7ff75e3a8640 1 -- 172.21.15.26:0/4224065231 reap_dead start 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 shutdown_connections 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 >> 172.21.15.26:0/4224065231 conn(0x7ff75806eb20 msgr2=0x7ff758158470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f897ffff640 1 -- 172.21.15.26:0/3922332906 reap_dead start 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 shutdown_connections 2024-04-25T13:16:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 >> 172.21.15.26:0/3922332906 conn(0x7f898006fd40 msgr2=0x7f8980159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7fc63dfad640 1 -- 172.21.15.26:0/2835223542 wait complete. 2024-04-25T13:16:44.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 shutdown_connections 2024-04-25T13:16:44.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7f8965ffb640 1 -- 172.21.15.26:0/3922332906 wait complete. 2024-04-25T13:16:44.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 shutdown_connections 2024-04-25T13:16:44.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.952+0000 7ff75fe0b640 1 -- 172.21.15.26:0/4224065231 wait complete. 2024-04-25T13:16:44.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.953+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 --> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27e4002d50 con 0x7f27e0076130 2024-04-25T13:16:44.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.954+0000 7f6532aae640 1 -- 172.21.15.26:0/1050080649 --> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f652c0cb490 con 0x7f6510076160 2024-04-25T13:16:44.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.954+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 --> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5b8002d50 con 0x7fb5b4076160 2024-04-25T13:16:44.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.954+0000 7f27f2ffd640 1 -- 172.21.15.26:0/2213596841 <== osd.3 v2:172.21.15.26:6824/3590411791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27e4002d50 con 0x7f27e0076130 2024-04-25T13:16:44.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.953+0000 7f556759e640 1 -- 172.21.15.26:0/1527475723 --> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55600d9670 con 0x7f5548076160 2024-04-25T13:16:44.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.954+0000 7f65297fa640 1 -- 172.21.15.26:0/1050080649 <== osd.1 v2:172.21.15.26:6800/1755672510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f652c0cb490 con 0x7f6510076160 2024-04-25T13:16:44.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.954+0000 7fb5c2ffd640 1 -- 172.21.15.26:0/3535057004 <== osd.0 v2:172.21.15.26:6816/2347346544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5b8002d50 con 0x7fb5b4076160 2024-04-25T13:16:44.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7f5556ffd640 1 -- 172.21.15.26:0/1527475723 <== osd.4 v2:172.21.15.169:6816/1358743323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f55600d9670 con 0x7f5548076160 2024-04-25T13:16:44.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f27e0076130 msgr2=0x7f27e0078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7f2804442640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f27e0076130 0x7f27e0078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fb5b4076160 msgr2=0x7fb5b40785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fb5b4076160 0x7fb5b40785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f27e006c9c0 msgr2=0x7f27e006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb5b406c9f0 msgr2=0x7fb5b406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb5b406c9f0 0x7fb5b406eeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00da60 tx=0x7fb5d40ab000 comp rx=0 tx=0).stop 2024-04-25T13:16:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc0e6d10 msgr2=0x7fb5cc0d9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 --2- 172.21.15.26:0/3535057004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5cc0e6d10 0x7fb5cc0d9520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800e7f0 tx=0x7fb5c800ecb0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d2d9d640 1 -- 172.21.15.26:0/3535057004 reap_dead start 2024-04-25T13:16:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7f2804442640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f27e006c9c0 0x7f27e006ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27f4005fb0 tx=0x7f27f4005f40 comp rx=0 tx=0).stop 2024-04-25T13:16:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 shutdown_connections 2024-04-25T13:16:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.955+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 >> 172.21.15.26:0/3535057004 conn(0x7fb5cc00e690 msgr2=0x7fb5cc0db9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27fc1459c0 msgr2=0x7f27fc154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f2804442640 1 --2- 172.21.15.26:0/2213596841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27fc1459c0 0x7f27fc154fa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c2c0 tx=0x7f27ec001990 comp rx=0 tx=0).stop 2024-04-25T13:16:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f28029df640 1 -- 172.21.15.26:0/2213596841 reap_dead start 2024-04-25T13:16:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 shutdown_connections 2024-04-25T13:16:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f6516ffd640 1 -- 172.21.15.26:0/1050080649 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7f6510076160 msgr2=0x7f65100785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f6516ffd640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7f6510076160 0x7f65100785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7fb5d88fd640 1 -- 172.21.15.26:0/3535057004 wait complete. 2024-04-25T13:16:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 shutdown_connections 2024-04-25T13:16:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 >> 172.21.15.26:0/2213596841 conn(0x7f27fc0c8f00 msgr2=0x7f27fc0c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f6516ffd640 1 -- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f651006c9f0 msgr2=0x7f651006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f6516ffd640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f651006c9f0 0x7f651006eeb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65200079a0 tx=0x7f6520008040 comp rx=0 tx=0).stop 2024-04-25T13:16:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f6516ffd640 1 -- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652c1510b0 msgr2=0x7f652c1f0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f6516ffd640 1 --2- 172.21.15.26:0/1050080649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652c1510b0 0x7f652c1f0570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f652400ca80 tx=0x7f652400cf40 comp rx=0 tx=0).stop 2024-04-25T13:16:44.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 shutdown_connections 2024-04-25T13:16:44.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f2804442640 1 -- 172.21.15.26:0/2213596841 wait complete. 2024-04-25T13:16:44.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 -- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f5548076160 msgr2=0x7f55480785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f5548076160 0x7f55480785a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 -- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f554806c9f0 msgr2=0x7f554806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f554806c9f0 0x7f554806eeb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f556004af20 tx=0x7f555c009040 comp rx=0 tx=0).stop 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 -- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f556004cab0 msgr2=0x7f55600e4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 --2- 172.21.15.26:0/1527475723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f556004cab0 0x7f55600e4780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f555800c390 tx=0x7f555800c850 comp rx=0 tx=0).stop 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5566d9d640 1 -- 172.21.15.26:0/1527475723 reap_dead start 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 -- 172.21.15.26:0/1527475723 shutdown_connections 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.956+0000 7f5554ff9640 1 -- 172.21.15.26:0/1527475723 >> 172.21.15.26:0/1527475723 conn(0x7f556000e150 msgr2=0x7f5560038c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.957+0000 7f653104b640 1 -- 172.21.15.26:0/1050080649 reap_dead start 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.957+0000 7f6516ffd640 1 -- 172.21.15.26:0/1050080649 shutdown_connections 2024-04-25T13:16:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.957+0000 7f6516ffd640 1 -- 172.21.15.26:0/1050080649 >> 172.21.15.26:0/1050080649 conn(0x7f652c0c8cf0 msgr2=0x7f652c06f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.957+0000 7f5554ff9640 1 -- 172.21.15.26:0/1527475723 shutdown_connections 2024-04-25T13:16:44.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.957+0000 7f5554ff9640 1 -- 172.21.15.26:0/1527475723 wait complete. 2024-04-25T13:16:44.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.957+0000 7f6516ffd640 1 -- 172.21.15.26:0/1050080649 shutdown_connections 2024-04-25T13:16:44.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:43.957+0000 7f6516ffd640 1 -- 172.21.15.26:0/1050080649 wait complete. 2024-04-25T13:16:44.019 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:44.019 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:16:44.020 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:44.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:16:44.021 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:44.021 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:16:44.022 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:44.022 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:16:44.023 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:44.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:16:44.024 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:44.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:16:44.025 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:44.025 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:16:44.026 INFO:teuthology.orchestra.run.smithi026.stdout:60129542156 2024-04-25T13:16:44.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:16:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.231+0000 7f29385d8640 1 Processor -- start 2024-04-25T13:16:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.231+0000 7f29385d8640 1 -- start start 2024-04-25T13:16:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7f29385d8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f293008d6b0 0x7f2930074230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7f29385d8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2930167ec0 con 0x7f2930071500 2024-04-25T13:16:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7f29385d8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2930168c40 con 0x7f29300c4310 2024-04-25T13:16:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7f29385d8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f29301687b0 con 0x7f293008d6b0 2024-04-25T13:16:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7f2936374640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2930071500 0x7f293006e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39256/0 (socket says 172.21.15.26:39256) 2024-04-25T13:16:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7f2936374640 1 -- 172.21.15.26:0/3029633828 learned_addr learned my addr 172.21.15.26:0/3029633828 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7f2936b75640 1 --2- 172.21.15.26:0/3029633828 >> v2:172.21.15.26:3300/0 conn(0x7f293008d6b0 0x7f2930074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.233+0000 7fef1fe43640 1 Processor -- start 2024-04-25T13:16:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.234+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124762844 0 0) 0x7f2930168c40 con 0x7f29300c4310 2024-04-25T13:16:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.234+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f291c003520 con 0x7f29300c4310 2024-04-25T13:16:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.234+0000 7fb32c219640 1 Processor -- start 2024-04-25T13:16:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.234+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457827601 0 0) 0x7f2930167ec0 con 0x7f2930071500 2024-04-25T13:16:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.234+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2930168c40 con 0x7f2930071500 2024-04-25T13:16:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2759270758 0 0) 0x7f2930168c40 con 0x7f2930071500 2024-04-25T13:16:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 >> v2:172.21.15.26:3300/0 conn(0x7f293008d6b0 msgr2=0x7f2930074230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 --2- 172.21.15.26:0/3029633828 >> v2:172.21.15.26:3300/0 conn(0x7f293008d6b0 0x7f2930074230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 >> v1:172.21.15.169:6789/0 conn(0x7f29300c4310 legacy=0x7f293006ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7fb32c219640 1 -- start start 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293006f850 con 0x7f2930071500 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f2920001690 con 0x7f2930071500 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 >> v1:172.21.15.26:6789/0 conn(0x7f2930071500 legacy=0x7f293006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c003b40 0x7f291c003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f291c004800 0x7f291c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c0051c0 0x7f291c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29301687b0 con 0x7f291c0051c0 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f291c00c0f0 con 0x7f291c003b40 2024-04-25T13:16:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f291c00c2f0 con 0x7f291c004800 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.234+0000 7fef1fe43640 1 -- start start 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7fef1fe43640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c38e0 0x7fef180c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7fef1fe43640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef181603c0 con 0x7fef180c8df0 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7fef1fe43640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef180c7790 con 0x7fef181595d0 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.235+0000 7fef1fe43640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fef1815fe90 con 0x7fef180c38e0 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7fef1e3e0640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fef180c8df0 0x7fef18162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39272/0 (socket says 172.21.15.26:39272) 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7fef1e3e0640 1 -- 172.21.15.26:0/3585362451 learned_addr learned my addr 172.21.15.26:0/3585362451 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7fef1d3de640 1 --2- 172.21.15.26:0/3585362451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c38e0 0x7fef180c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2935b73640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f291c004800 0x7f291c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7fef1d3de640 1 -- 172.21.15.26:0/3585362451 >> v1:172.21.15.169:6789/0 conn(0x7fef181595d0 legacy=0x7fef180cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7fef1d3de640 1 -- 172.21.15.26:0/3585362451 >> v1:172.21.15.26:6789/0 conn(0x7fef180c8df0 legacy=0x7fef18162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7fef1d3de640 1 -- 172.21.15.26:0/3585362451 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef181600e0 con 0x7fef180c38e0 2024-04-25T13:16:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2935b73640 1 -- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c003b40 msgr2=0x7f291c003f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2935b73640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c003b40 0x7f291c003f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2935b73640 1 -- 172.21.15.26:0/3029633828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c0051c0 msgr2=0x7f291c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2936b75640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c0051c0 0x7f291c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2935b73640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c0051c0 0x7f291c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2935b73640 1 -- 172.21.15.26:0/3029633828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2930168c40 con 0x7f291c004800 2024-04-25T13:16:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2936b75640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c0051c0 0x7f291c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.236+0000 7f2936b75640 1 -- 172.21.15.26:0/3029633828 reap_dead start 2024-04-25T13:16:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb32c219640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3240c7550 0x7fb3240c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb32c219640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb3240c7930 0x7fb3241549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb32c219640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32415f180 con 0x7fb3240c3e40 2024-04-25T13:16:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7f38a00dc640 1 Processor -- start 2024-04-25T13:16:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb32c219640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb3240c98f0 con 0x7fb3240c7550 2024-04-25T13:16:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb32c219640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb3240c88e0 con 0x7fb3240c7930 2024-04-25T13:16:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb329fb5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3240c7550 0x7fb3240c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb32a7b6640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fb3240c3e40 0x7fb32415e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42576/0 (socket says 172.21.15.26:42576) 2024-04-25T13:16:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fb32a7b6640 1 -- 172.21.15.26:0/20679824 learned_addr learned my addr 172.21.15.26:0/20679824 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7f38a00dc640 1 -- start start 2024-04-25T13:16:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.237+0000 7fef1d3de640 1 --2- 172.21.15.26:0/3585362451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c38e0 0x7fef180c8710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef10009df0 tx=0x7fef1002a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3355c6b1bbb4389 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fb329fb5640 1 -- 172.21.15.26:0/20679824 >> v2:172.21.15.169:3300/0 conn(0x7fb3240c7930 msgr2=0x7fb3241549f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fb329fb5640 1 --2- 172.21.15.26:0/20679824 >> v2:172.21.15.169:3300/0 conn(0x7fb3240c7930 0x7fb3241549f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fb329fb5640 1 -- 172.21.15.26:0/20679824 >> v1:172.21.15.169:6789/0 conn(0x7fb3240c3e40 legacy=0x7fb32415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7f2935b73640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f291c004800 0x7f291c004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2928002000 tx=0x7f291c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e4c45a929dc3e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fef1cbdd640 1 -- 172.21.15.26:0/3585362451 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10007740 con 0x7fef180c38e0 2024-04-25T13:16:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fe6832bb640 1 Processor -- start 2024-04-25T13:16:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928001c20 con 0x7f291c004800 2024-04-25T13:16:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fb329fb5640 1 -- 172.21.15.26:0/20679824 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240c8b30 con 0x7fb3240c7550 2024-04-25T13:16:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2928003b90 con 0x7f291c004800 2024-04-25T13:16:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fe6832bb640 1 -- start start 2024-04-25T13:16:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7f2935372640 1 -- 172.21.15.26:0/3029633828 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29280050d0 con 0x7f291c004800 2024-04-25T13:16:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fb328fb3640 1 -- 172.21.15.26:0/20679824 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76968649 0 0) 0x7fb32415f180 con 0x7fb3240c3e40 2024-04-25T13:16:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7f51bd3ad640 1 Processor -- start 2024-04-25T13:16:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7f51bd3ad640 1 -- start start 2024-04-25T13:16:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f38a00dc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38981601d0 0x7f38980c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f38a00dc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3898159c90 con 0x7f38981598b0 2024-04-25T13:16:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f38a00dc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38980c9370 con 0x7f38980c2780 2024-04-25T13:16:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f38a00dc640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f38980ca800 con 0x7f38981601d0 2024-04-25T13:16:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f389de78640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f38981598b0 0x7f389815fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39274/0 (socket says 172.21.15.26:39274) 2024-04-25T13:16:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f389de78640 1 -- 172.21.15.26:0/3937928374 learned_addr learned my addr 172.21.15.26:0/3937928374 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f389d677640 1 --2- 172.21.15.26:0/3937928374 >> v2:172.21.15.26:3300/0 conn(0x7f38981601d0 0x7f38980c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.238+0000 7fef1cbdd640 1 -- 172.21.15.26:0/3585362451 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef100078e0 con 0x7fef180c38e0 2024-04-25T13:16:44.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f389d677640 1 -- 172.21.15.26:0/3937928374 >> v1:172.21.15.169:6789/0 conn(0x7f38980c2780 legacy=0x7f38980c2bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:44.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f389d677640 1 -- 172.21.15.26:0/3937928374 >> v1:172.21.15.26:6789/0 conn(0x7f38981598b0 legacy=0x7f389815fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f29385d8640 1 -- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f291c004800 msgr2=0x7f291c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f29385d8640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f291c004800 0x7f291c004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2928002000 tx=0x7f291c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:44.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f51bd3ad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b81554e0 0x7f51b815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7f389d677640 1 -- 172.21.15.26:0/3937928374 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38980c9630 con 0x7f38981601d0 2024-04-25T13:16:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fb329fb5640 1 --2- 172.21.15.26:0/20679824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c7550 0x7fb3240c3900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7f233a6bc9dc8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fed09b6b640 1 Processor -- start 2024-04-25T13:16:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fef1fe43640 1 -- 172.21.15.26:0/3585362451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c38e0 msgr2=0x7fef180c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fef1fe43640 1 --2- 172.21.15.26:0/3585362451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c38e0 0x7fef180c8710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef10009df0 tx=0x7fef1002a630 comp rx=0 tx=0).stop 2024-04-25T13:16:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fef1fe43640 1 -- 172.21.15.26:0/3585362451 shutdown_connections 2024-04-25T13:16:44.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fef1fe43640 1 --2- 172.21.15.26:0/3585362451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c38e0 0x7fef180c8710 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fef1fe43640 1 -- 172.21.15.26:0/3585362451 >> 172.21.15.26:0/3585362451 conn(0x7fef18074d50 msgr2=0x7fef18075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fed09b6b640 1 -- start start 2024-04-25T13:16:44.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51bd3ad640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f51b80b3c00 0x7f51b80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fe6832bb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe67c06e850 0x7fe67c0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fe6832bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 0x7fe67c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f29385d8640 1 -- 172.21.15.26:0/3029633828 shutdown_connections 2024-04-25T13:16:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f29385d8640 1 --2- 172.21.15.26:0/3029633828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f291c004800 0x7f291c004c80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f29385d8640 1 -- 172.21.15.26:0/3029633828 >> 172.21.15.26:0/3029633828 conn(0x7f29300c8f00 msgr2=0x7f29300c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fe6832bb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe67c06ec30 0x7fe67c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fe6832bb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe67c0c7bb0 con 0x7fe67c06e850 2024-04-25T13:16:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fe6832bb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe67c06f270 con 0x7fe67c06ec30 2024-04-25T13:16:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.239+0000 7fe6832bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe67c0c6fa0 con 0x7fe67c0c8160 2024-04-25T13:16:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe67c06ec30 0x7fe67c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe67c06ec30 0x7fe67c154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:36960/0 (socket says 172.21.15.26:36960) 2024-04-25T13:16:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 -- 172.21.15.26:0/1817344464 learned_addr learned my addr 172.21.15.26:0/1817344464 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681057640 1 --2- 172.21.15.26:0/1817344464 >> v2:172.21.15.26:3300/0 conn(0x7fe67c06e850 0x7fe67c0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b81554e0 0x7f51b815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51bd3ad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51b80b5450 0x7f51b80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b81554e0 0x7f51b815f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58688/0 (socket says 172.21.15.26:58688) 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51bd3ad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f51b80b4a80 con 0x7f51b80b5450 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51bd3ad640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f51b81558c0 con 0x7f51b80b3c00 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51b6ffd640 1 -- 172.21.15.26:0/1623930850 learned_addr learned my addr 172.21.15.26:0/1623930850 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51bd3ad640 1 -- 172.21.15.26:0/1623930850 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f51b815f630 con 0x7f51b81554e0 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51b77fe640 1 --2- 172.21.15.26:0/1623930850 >> v2:172.21.15.26:3300/0 conn(0x7f51b80b5450 0x7f51b80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f51b67fc640 1 --2- 172.21.15.26:0/1623930850 >> v2:172.21.15.169:3300/0 conn(0x7f51b80b3c00 0x7f51b80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fb328fb3640 1 -- 172.21.15.26:0/20679824 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c007740 con 0x7fb3240c7550 2024-04-25T13:16:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f389d677640 1 --2- 172.21.15.26:0/3937928374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 0x7f38980c7970 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38940097a0 tx=0x7f389402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64d23ed8bb2a985 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f51b77fe640 1 -- 172.21.15.26:0/1623930850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b81554e0 msgr2=0x7f51b815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f51b77fe640 1 --2- 172.21.15.26:0/1623930850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b81554e0 0x7f51b815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fb328fb3640 1 -- 172.21.15.26:0/20679824 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c0078e0 con 0x7fb3240c7550 2024-04-25T13:16:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f51b77fe640 1 -- 172.21.15.26:0/1623930850 >> v2:172.21.15.169:3300/0 conn(0x7f51b80b3c00 msgr2=0x7f51b80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f51b77fe640 1 --2- 172.21.15.26:0/1623930850 >> v2:172.21.15.169:3300/0 conn(0x7f51b80b3c00 0x7f51b80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f51b77fe640 1 -- 172.21.15.26:0/1623930850 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b80cb8c0 con 0x7f51b80b5450 2024-04-25T13:16:44.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fb328fb3640 1 -- 172.21.15.26:0/20679824 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c007cb0 con 0x7fb3240c7550 2024-04-25T13:16:44.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f51b67fc640 1 --2- 172.21.15.26:0/1623930850 >> v2:172.21.15.169:3300/0 conn(0x7f51b80b3c00 0x7f51b80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:44.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f4b969b4640 1 Processor -- start 2024-04-25T13:16:44.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7f4b969b4640 1 -- start start 2024-04-25T13:16:44.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f29385d8640 1 -- 172.21.15.26:0/3029633828 shutdown_connections 2024-04-25T13:16:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed09b6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed0415b400 0x7fed04072000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed09b6b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed040cd290 0x7fed04158910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed09b6b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed04157e90 con 0x7fed04152060 2024-04-25T13:16:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed09b6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fed04158e50 con 0x7fed0415b400 2024-04-25T13:16:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed09b6b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fed04072620 con 0x7fed040cd290 2024-04-25T13:16:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b969b4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b901554e0 0x7f4b9015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed08b69640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fed04152060 0x7fed040714e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42594/0 (socket says 172.21.15.26:42594) 2024-04-25T13:16:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed0936a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed040cd290 0x7fed04158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fed08b69640 1 -- 172.21.15.26:0/599347774 learned_addr learned my addr 172.21.15.26:0/599347774 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 -- 172.21.15.26:0/1817344464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 msgr2=0x7fe67c0c40c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fed03fff640 1 --2- 172.21.15.26:0/599347774 >> v2:172.21.15.26:3300/0 conn(0x7fed0415b400 0x7fed04072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 --2- 172.21.15.26:0/1817344464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 0x7fe67c0c40c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 -- 172.21.15.26:0/1817344464 >> v2:172.21.15.26:3300/0 conn(0x7fe67c06e850 msgr2=0x7fe67c0c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 --2- 172.21.15.26:0/1817344464 >> v2:172.21.15.26:3300/0 conn(0x7fe67c06e850 0x7fe67c0c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fb32c219640 1 -- 172.21.15.26:0/20679824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c7550 msgr2=0x7fb3240c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fb32c219640 1 --2- 172.21.15.26:0/20679824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c7550 0x7fb3240c3900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c02a6c0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f389ce76640 1 -- 172.21.15.26:0/3937928374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894037070 con 0x7f38981601d0 2024-04-25T13:16:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fe681858640 1 -- 172.21.15.26:0/1817344464 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c0c7280 con 0x7fe67c06ec30 2024-04-25T13:16:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f389ce76640 1 -- 172.21.15.26:0/3937928374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894032440 con 0x7f38981601d0 2024-04-25T13:16:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f389ce76640 1 -- 172.21.15.26:0/3937928374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894032810 con 0x7f38981601d0 2024-04-25T13:16:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fed03fff640 1 -- 172.21.15.26:0/599347774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed040cd290 msgr2=0x7fed04158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fed03fff640 1 --2- 172.21.15.26:0/599347774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed040cd290 0x7fed04158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fed03fff640 1 -- 172.21.15.26:0/599347774 >> v1:172.21.15.169:6789/0 conn(0x7fed04152060 legacy=0x7fed040714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fed03fff640 1 -- 172.21.15.26:0/599347774 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed040728e0 con 0x7fed0415b400 2024-04-25T13:16:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7fe681057640 1 --2- 172.21.15.26:0/1817344464 >> v2:172.21.15.26:3300/0 conn(0x7fe67c06e850 0x7fe67c0c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b969b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900b3c00 0x7f4b900b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b969b4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b901558c0 con 0x7f4b900b5450 2024-04-25T13:16:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b969b4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f4b900b4a80 con 0x7f4b901554e0 2024-04-25T13:16:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b969b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9015f630 con 0x7f4b900b3c00 2024-04-25T13:16:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b94f51640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b900b5450 0x7f4b900d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39288/0 (socket says 172.21.15.26:39288) 2024-04-25T13:16:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b94f51640 1 -- 172.21.15.26:0/1695237434 learned_addr learned my addr 172.21.15.26:0/1695237434 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1695237434 >> v2:172.21.15.26:3300/0 conn(0x7f4b901554e0 0x7f4b9015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231548194 0 0) 0x7f4b88001490 con 0x7f4b900b5450 2024-04-25T13:16:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b78003520 con 0x7f4b900b5450 2024-04-25T13:16:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.241+0000 7f29385d8640 1 -- 172.21.15.26:0/3029633828 wait complete. 2024-04-25T13:16:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fe681858640 1 --2- 172.21.15.26:0/1817344464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 0x7fe67c154c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0c37b0 tx=0x7fe67402a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0376f40edf77fcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fe673fff640 1 -- 172.21.15.26:0/1817344464 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674036070 con 0x7fe67c06ec30 2024-04-25T13:16:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fe673fff640 1 -- 172.21.15.26:0/1817344464 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe674031600 con 0x7fe67c06ec30 2024-04-25T13:16:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fef1fe43640 1 -- 172.21.15.26:0/3585362451 shutdown_connections 2024-04-25T13:16:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.240+0000 7fef1fe43640 1 -- 172.21.15.26:0/3585362451 wait complete. 2024-04-25T13:16:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fef1fe43640 1 Processor -- start 2024-04-25T13:16:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7fef1fe43640 1 -- start start 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 775622732 0 0) 0x7f4b78003520 con 0x7f4b900b5450 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900b3c00 msgr2=0x7f4b900b4f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900b3c00 0x7f4b900b4f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 >> v2:172.21.15.26:3300/0 conn(0x7f4b901554e0 msgr2=0x7f4b9015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 --2- 172.21.15.26:0/1695237434 >> v2:172.21.15.26:3300/0 conn(0x7f4b901554e0 0x7f4b9015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b900cb8c0 con 0x7f4b900b5450 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f4b88001bc0 con 0x7f4b900b5450 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 >> v1:172.21.15.26:6789/0 conn(0x7f4b900b5450 legacy=0x7f4b900d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.242+0000 7f4b8effd640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8effd640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b780043a0 0x7f4b78004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8effd640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b78005080 0x7f4b780141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4b900b4a80 con 0x7f4b780043a0 2024-04-25T13:16:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9015f630 con 0x7f4b78005080 2024-04-25T13:16:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b78014820 con 0x7f4b780039b0 2024-04-25T13:16:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe673fff640 1 -- 172.21.15.26:0/1817344464 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6740319d0 con 0x7fe67c06ec30 2024-04-25T13:16:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b780043a0 0x7f4b78004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f38a00dc640 1 -- 172.21.15.26:0/3937928374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 msgr2=0x7f38980c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f38a00dc640 1 --2- 172.21.15.26:0/3937928374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 0x7f38980c7970 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38940097a0 tx=0x7f389402a270 comp rx=0 tx=0).stop 2024-04-25T13:16:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f51b77fe640 1 --2- 172.21.15.26:0/1623930850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b5450 0x7f51b80d08a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51b80ce4b0 tx=0x7f51b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d81d857793eb64e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 -- 172.21.15.26:0/1817344464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 msgr2=0x7fe67c154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1817344464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 0x7fe67c154c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0c37b0 tx=0x7fe67402a760 comp rx=0 tx=0).stop 2024-04-25T13:16:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 -- 172.21.15.26:0/1817344464 shutdown_connections 2024-04-25T13:16:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1817344464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 0x7fe67c154c60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1817344464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 0x7fe67c0c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1817344464 >> v2:172.21.15.26:3300/0 conn(0x7fe67c06e850 0x7fe67c0c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 -- 172.21.15.26:0/1817344464 >> 172.21.15.26:0/1817344464 conn(0x7fe67c0c8f00 msgr2=0x7fe67c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b94f51640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b78005080 0x7f4b780141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8ffff640 1 -- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b78005080 msgr2=0x7f4b780141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f29385d8640 1 Processor -- start 2024-04-25T13:16:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fed03fff640 1 --2- 172.21.15.26:0/599347774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed04072000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fecf400bfa0 tx=0x7fecf402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3de49ef3e2373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f29385d8640 1 -- start start 2024-04-25T13:16:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f38a00dc640 1 -- 172.21.15.26:0/3937928374 shutdown_connections 2024-04-25T13:16:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f38a00dc640 1 --2- 172.21.15.26:0/3937928374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 0x7f38980c7970 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f38a00dc640 1 -- 172.21.15.26:0/3937928374 >> 172.21.15.26:0/3937928374 conn(0x7f38980c9a70 msgr2=0x7f38980c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fb32c219640 1 -- 172.21.15.26:0/20679824 shutdown_connections 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fb32c219640 1 --2- 172.21.15.26:0/20679824 >> v2:172.21.15.169:3300/0 conn(0x7fb3240c7930 0x7fb3241549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fb32c219640 1 --2- 172.21.15.26:0/20679824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c7550 0x7fb3240c3900 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fb32c219640 1 -- 172.21.15.26:0/20679824 >> 172.21.15.26:0/20679824 conn(0x7fb32406eb20 msgr2=0x7fb32406ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fef1fe43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef180c38e0 0x7fef180cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fef1fe43640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c8df0 0x7fef18073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fef1fe43640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef181595d0 0x7fef18158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fef1fe43640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fef180cd120 con 0x7fef181595d0 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fef1fe43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef180ccfa0 con 0x7fef180c38e0 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fef1fe43640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fef181599b0 con 0x7fef180c8df0 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fef1d3de640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c8df0 0x7fef18073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fef1d3de640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c8df0 0x7fef18073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58736/0 (socket says 172.21.15.26:58736) 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fef1d3de640 1 -- 172.21.15.26:0/2749110475 learned_addr learned my addr 172.21.15.26:0/2749110475 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fef1dbdf640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef180c38e0 0x7fef180cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b78005080 0x7f4b780141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8ffff640 1 -- 172.21.15.26:0/1695237434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b780043a0 msgr2=0x7f4b78004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:44.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b780043a0 0x7f4b78004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8ffff640 1 -- 172.21.15.26:0/1695237434 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b900cb8c0 con 0x7f4b780039b0 2024-04-25T13:16:44.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b780043a0 0x7f4b78004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:44.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f4b94f51640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b78005080 0x7f4b780141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:44.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 -- 172.21.15.26:0/1817344464 shutdown_connections 2024-04-25T13:16:44.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.243+0000 7fe6832bb640 1 -- 172.21.15.26:0/1817344464 wait complete. 2024-04-25T13:16:44.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fb32c219640 1 -- 172.21.15.26:0/20679824 shutdown_connections 2024-04-25T13:16:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fed037fe640 1 -- 172.21.15.26:0/599347774 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4039070 con 0x7fed0415b400 2024-04-25T13:16:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fed037fe640 1 -- 172.21.15.26:0/599347774 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4009540 con 0x7fed0415b400 2024-04-25T13:16:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fed037fe640 1 -- 172.21.15.26:0/599347774 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4039070 con 0x7fed0415b400 2024-04-25T13:16:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f51b5ffb640 1 -- 172.21.15.26:0/1623930850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0007740 con 0x7f51b80b5450 2024-04-25T13:16:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f38a00dc640 1 -- 172.21.15.26:0/3937928374 shutdown_connections 2024-04-25T13:16:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f51b5ffb640 1 -- 172.21.15.26:0/1623930850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b00078e0 con 0x7f51b80b5450 2024-04-25T13:16:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f51b5ffb640 1 -- 172.21.15.26:0/1623930850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0007cb0 con 0x7f51b80b5450 2024-04-25T13:16:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fef1e3e0640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef181595d0 0x7fef18158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b78003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009af0 tx=0x7f4b78005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839cb8a6bdcce62c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f29385d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c004800 0x7f29301f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f29385d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29301615b0 0x7f2930166460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80036070 con 0x7f4b780039b0 2024-04-25T13:16:44.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f29385d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930206170 0x7f2930206620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80031400 con 0x7f4b780039b0 2024-04-25T13:16:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f4b8effd640 1 -- 172.21.15.26:0/1695237434 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80009690 con 0x7f4b780039b0 2024-04-25T13:16:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7f38a00dc640 1 -- 172.21.15.26:0/3937928374 wait complete. 2024-04-25T13:16:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f29385d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f293006f4a0 con 0x7f291c004800 2024-04-25T13:16:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f29385d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2930168440 con 0x7f2930206170 2024-04-25T13:16:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f29385d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f29301f9160 con 0x7f29301615b0 2024-04-25T13:16:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fef1e3e0640 1 -- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c8df0 msgr2=0x7fef18073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fef1e3e0640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c8df0 0x7fef18073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fef1e3e0640 1 -- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef180c38e0 msgr2=0x7fef180cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fef1e3e0640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef180c38e0 0x7fef180cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fef1e3e0640 1 -- 172.21.15.26:0/2749110475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef180714b0 con 0x7fef181595d0 2024-04-25T13:16:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fed09b6b640 1 -- 172.21.15.26:0/599347774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 msgr2=0x7fed04072000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fed09b6b640 1 --2- 172.21.15.26:0/599347774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed04072000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fecf400bfa0 tx=0x7fecf402c8a0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f51bd3ad640 1 -- 172.21.15.26:0/1623930850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b5450 msgr2=0x7f51b80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fe6832bb640 1 Processor -- start 2024-04-25T13:16:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fe6832bb640 1 -- start start 2024-04-25T13:16:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/1623930850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b5450 0x7f51b80d08a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51b80ce4b0 tx=0x7f51b002a660 comp rx=0 tx=0).stop 2024-04-25T13:16:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fed09b6b640 1 -- 172.21.15.26:0/599347774 shutdown_connections 2024-04-25T13:16:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f51bd3ad640 1 -- 172.21.15.26:0/1623930850 shutdown_connections 2024-04-25T13:16:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/1623930850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b5450 0x7f51b80d08a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/1623930850 >> v2:172.21.15.169:3300/0 conn(0x7f51b80b3c00 0x7f51b80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/1623930850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b81554e0 0x7f51b815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7f51bd3ad640 1 -- 172.21.15.26:0/1623930850 >> 172.21.15.26:0/1623930850 conn(0x7f51b8074d50 msgr2=0x7f51b8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fed09b6b640 1 --2- 172.21.15.26:0/599347774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed040cd290 0x7fed04158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.245+0000 7fed09b6b640 1 --2- 172.21.15.26:0/599347774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed04072000 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fed09b6b640 1 -- 172.21.15.26:0/599347774 >> 172.21.15.26:0/599347774 conn(0x7fed040cc7a0 msgr2=0x7fed040ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fef1e3e0640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef181595d0 0x7fef18158000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c390 tx=0x7fef0800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f51bd3ad640 1 -- 172.21.15.26:0/1623930850 shutdown_connections 2024-04-25T13:16:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.244+0000 7fb32c219640 1 -- 172.21.15.26:0/20679824 wait complete. 2024-04-25T13:16:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f51bd3ad640 1 -- 172.21.15.26:0/1623930850 wait complete. 2024-04-25T13:16:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f38a00dc640 1 Processor -- start 2024-04-25T13:16:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fb32c219640 1 Processor -- start 2024-04-25T13:16:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f4b969b4640 1 -- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 msgr2=0x7f4b78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f4b969b4640 1 --2- 172.21.15.26:0/1695237434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b78003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009af0 tx=0x7f4b78005830 comp rx=0 tx=0).stop 2024-04-25T13:16:44.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f38a00dc640 1 -- start start 2024-04-25T13:16:44.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f4b94f51640 1 -- 172.21.15.26:0/1695237434 reap_dead start 2024-04-25T13:16:44.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f4b969b4640 1 -- 172.21.15.26:0/1695237434 shutdown_connections 2024-04-25T13:16:44.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f4b969b4640 1 -- 172.21.15.26:0/1695237434 >> 172.21.15.26:0/1695237434 conn(0x7f4b90074d50 msgr2=0x7f4b90075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f4b969b4640 1 -- 172.21.15.26:0/1695237434 shutdown_connections 2024-04-25T13:16:44.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f4b969b4640 1 -- 172.21.15.26:0/1695237434 wait complete. 2024-04-25T13:16:44.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7f2935b73640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29301615b0 0x7f2930166460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe6832bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe67c06e850 0x7fe67c148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe6832bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 0x7fe67c148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe6832bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 0x7fe67c0cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe6832bb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c06f4a0 con 0x7fe67c06e850 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe681057640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe67c06e850 0x7fe67c148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7f2936b75640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930206170 0x7f2930206620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe681057640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe67c06e850 0x7fe67c148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52194/0 (socket says 172.21.15.26:52194) 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe681057640 1 -- 172.21.15.26:0/1560035275 learned_addr learned my addr 172.21.15.26:0/1560035275 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c0c7840 con 0x7fe67c06ec30 2024-04-25T13:16:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe67c06f620 con 0x7fe67c0c8160 2024-04-25T13:16:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7f2936b75640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930206170 0x7f2930206620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:37008/0 (socket says 172.21.15.26:37008) 2024-04-25T13:16:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7f2936b75640 1 -- 172.21.15.26:0/3161301908 learned_addr learned my addr 172.21.15.26:0/3161301908 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fe681858640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 0x7fe67c0cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fe681057640 1 -- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 msgr2=0x7fe67c0cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fb32c219640 1 -- start start 2024-04-25T13:16:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fef0e7fc640 1 -- 172.21.15.26:0/2749110475 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08017070 con 0x7fef181595d0 2024-04-25T13:16:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fef0e7fc640 1 -- 172.21.15.26:0/2749110475 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef08005ce0 con 0x7fef181595d0 2024-04-25T13:16:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.246+0000 7fef0e7fc640 1 -- 172.21.15.26:0/2749110475 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080072d0 con 0x7fef181595d0 2024-04-25T13:16:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fe681057640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 0x7fe67c0cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fe681057640 1 -- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 msgr2=0x7fe67c148a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fe681057640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 0x7fe67c148a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fe681057640 1 -- 172.21.15.26:0/1560035275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c158250 con 0x7fe67c06e850 2024-04-25T13:16:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7f2936374640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c004800 0x7f29301f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fb32c219640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c3e40 0x7fb32414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7f38a00dc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38980c2780 0x7f38981e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7f38a00dc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38981598b0 0x7f389815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef18071790 con 0x7fef181595d0 2024-04-25T13:16:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef180cc330 con 0x7fef181595d0 2024-04-25T13:16:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f38a00dc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 0x7f389815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f389de78640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38980c2780 0x7f38981e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f389de78640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38980c2780 0x7f38981e5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58772/0 (socket says 172.21.15.26:58772) 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f389de78640 1 -- 172.21.15.26:0/3185047842 learned_addr learned my addr 172.21.15.26:0/3185047842 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f38a00dc640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f389815f630 con 0x7f38981601d0 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f38a00dc640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f38980c7eb0 con 0x7f38981598b0 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f38a00dc640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f38980b2cf0 con 0x7f38980c2780 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2936b75640 1 -- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29301615b0 msgr2=0x7f2930166460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2936b75640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29301615b0 0x7f2930166460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2936b75640 1 -- 172.21.15.26:0/3161301908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c004800 msgr2=0x7f29301f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2936b75640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c004800 0x7f29301f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2936b75640 1 -- 172.21.15.26:0/3161301908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29302096a0 con 0x7f2930206170 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fb32c219640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3240c7550 0x7fb32414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fb32c219640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3240c7930 0x7fb32414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fb3297b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3240c7550 0x7fb32414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fb3297b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3240c7550 0x7fb32414d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58756/0 (socket says 172.21.15.26:58756) 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fb329fb5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c3e40 0x7fb32414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fb329fb5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c3e40 0x7fb32414cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52208/0 (socket says 172.21.15.26:52208) 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fb32c219640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240c93d0 con 0x7fb3240c3e40 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fb32c219640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240c90f0 con 0x7fb3240c7930 2024-04-25T13:16:44.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fb32c219640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb32415b000 con 0x7fb3240c7550 2024-04-25T13:16:44.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f4b969b4640 1 Processor -- start 2024-04-25T13:16:44.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f389e679640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 0x7f389815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fed09b6b640 1 -- 172.21.15.26:0/599347774 shutdown_connections 2024-04-25T13:16:44.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fed09b6b640 1 -- 172.21.15.26:0/599347774 wait complete. 2024-04-25T13:16:44.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f4b969b4640 1 -- start start 2024-04-25T13:16:44.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2936b75640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930206170 0x7f2930206620 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f293006dd80 tx=0x7f292c00eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f51bd3ad640 1 Processor -- start 2024-04-25T13:16:44.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f51bd3ad640 1 -- start start 2024-04-25T13:16:44.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2926ffd640 1 -- 172.21.15.26:0/3161301908 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c00cda0 con 0x7f2930206170 2024-04-25T13:16:44.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.247+0000 7fe681057640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe67c06e850 0x7fe67c148540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00ebe0 tx=0x7fe66c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fb3297b4640 1 -- 172.21.15.26:0/3216892010 learned_addr learned my addr 172.21.15.26:0/3216892010 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7fe671ffb640 1 -- 172.21.15.26:0/1560035275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c017070 con 0x7fe67c06e850 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f389de78640 1 -- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38981598b0 msgr2=0x7f389815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f389de78640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38981598b0 0x7f389815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f389de78640 1 -- 172.21.15.26:0/3185047842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 msgr2=0x7f389815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f389de78640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 0x7f389815a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f389de78640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38981e5650 con 0x7f38980c2780 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f389de78640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38980c2780 0x7f38981e5dc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f388800c400 tx=0x7f388800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f388e7fc640 1 -- 172.21.15.26:0/3185047842 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888017070 con 0x7f38980c2780 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f388e7fc640 1 -- 172.21.15.26:0/3185047842 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888005ce0 con 0x7f38980c2780 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f38a00dc640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38981e6880 con 0x7f38980c2780 2024-04-25T13:16:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef18071cb0 con 0x7fef181595d0 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c074280 con 0x7fe67c06e850 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c073700 con 0x7fe67c06e850 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7fe671ffb640 1 -- 172.21.15.26:0/1560035275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66c00cc30 con 0x7fe67c06e850 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7fe671ffb640 1 -- 172.21.15.26:0/1560035275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c013470 con 0x7fe67c06e850 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b969b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b901ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b969b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b90151050 0x7f4b900d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b969b4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b90151490 0x7f4b900cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b969b4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4b900b4430 con 0x7f4b90151050 2024-04-25T13:16:44.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b969b4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b900b4150 con 0x7f4b90151490 2024-04-25T13:16:44.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b969b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b900b4710 con 0x7f4b780039b0 2024-04-25T13:16:44.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f38a00dc640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38980cccf0 con 0x7f38980c2780 2024-04-25T13:16:44.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b901ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7fed09b6b640 1 Processor -- start 2024-04-25T13:16:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b94f51640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b90151490 0x7f4b900cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b901ed0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58780/0 (socket says 172.21.15.26:58780) 2024-04-25T13:16:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f4b8ffff640 1 -- 172.21.15.26:0/1581889647 learned_addr learned my addr 172.21.15.26:0/1581889647 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7fb32a7b6640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3240c7930 0x7fb32414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7fed09b6b640 1 -- start start 2024-04-25T13:16:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2926ffd640 1 -- 172.21.15.26:0/3161301908 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292c017440 con 0x7f2930206170 2024-04-25T13:16:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.248+0000 7f2926ffd640 1 -- 172.21.15.26:0/3161301908 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c017830 con 0x7f2930206170 2024-04-25T13:16:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2930209980 con 0x7f2930206170 2024-04-25T13:16:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.249+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2930209f40 con 0x7f2930206170 2024-04-25T13:16:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7f2924ff9640 1 -- 172.21.15.26:0/3161301908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2930068e40 con 0x7f2930206170 2024-04-25T13:16:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.250+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c005290 con 0x7fe67c06e850 2024-04-25T13:16:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b90151050 0x7f4b900d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7fef0e7fc640 1 -- 172.21.15.26:0/2749110475 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef0801a070 con 0x7fef181595d0 2024-04-25T13:16:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7fb3297b4640 1 -- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3240c7930 msgr2=0x7fb32414d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7fb3297b4640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3240c7930 0x7fb32414d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7fb3297b4640 1 -- 172.21.15.26:0/3216892010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c3e40 msgr2=0x7fb32414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7fb3297b4640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c3e40 0x7fb32414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7fb3297b4640 1 -- 172.21.15.26:0/3216892010 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb324157830 con 0x7fb3240c7550 2024-04-25T13:16:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7f388e7fc640 1 -- 172.21.15.26:0/3185047842 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38880072f0 con 0x7f38980c2780 2024-04-25T13:16:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fef0e7fc640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7feefc06c9c0 0x7feefc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.251+0000 7f51bd3ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b3c00 0x7f51b815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51bd3ad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b80b5450 0x7f51b8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51bd3ad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b81554e0 0x7f51b81f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b3c00 0x7f51b815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f4b8ffff640 1 -- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b90151490 msgr2=0x7f4b900cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b90151490 0x7f4b900cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f4b8ffff640 1 -- 172.21.15.26:0/1581889647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b90151050 msgr2=0x7f4b900d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b90151050 0x7f4b900d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f4b8ffff640 1 -- 172.21.15.26:0/1581889647 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b900ce7b0 con 0x7f4b780039b0 2024-04-25T13:16:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fed09b6b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed040cd290 0x7fed040c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b3c00 0x7f51b815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52224/0 (socket says 172.21.15.26:52224) 2024-04-25T13:16:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51b67fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b80b5450 0x7f51b8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fef0e7fc640 1 -- 172.21.15.26:0/2749110475 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fef0808afc0 con 0x7fef181595d0 2024-04-25T13:16:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fef1dbdf640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7feefc06c9c0 0x7feefc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51b67fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b80b5450 0x7f51b8157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58786/0 (socket says 172.21.15.26:58786) 2024-04-25T13:16:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fed09b6b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed04152060 0x7fed040cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fed09b6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed041ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51b6ffd640 1 -- 172.21.15.26:0/3638493043 learned_addr learned my addr 172.21.15.26:0/3638493043 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fe671ffb640 1 -- 172.21.15.26:0/1560035275 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe66c01a070 con 0x7fe67c06e850 2024-04-25T13:16:44.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fed08b69640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed040cd290 0x7fed040c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b4430 con 0x7f51b80b3c00 2024-04-25T13:16:44.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51b77fe640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b81554e0 0x7f51b81f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b4150 con 0x7f51b81554e0 2024-04-25T13:16:44.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f51b80b4710 con 0x7f51b80b5450 2024-04-25T13:16:44.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fed08b69640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed040cd290 0x7fed040c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:37064/0 (socket says 172.21.15.26:37064) 2024-04-25T13:16:44.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fb3297b4640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3240c7550 0x7fb32414d4b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb32000b450 tx=0x7fb32000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.252+0000 7fed03fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed04152060 0x7fed040cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed03fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed04152060 0x7fed040cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58802/0 (socket says 172.21.15.26:58802) 2024-04-25T13:16:44.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed0936a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed041ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed0936a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed041ecc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52228/0 (socket says 172.21.15.26:52228) 2024-04-25T13:16:44.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed08b69640 1 -- 172.21.15.26:0/695983866 learned_addr learned my addr 172.21.15.26:0/695983866 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:44.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fb31a7fc640 1 -- 172.21.15.26:0/3216892010 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320015020 con 0x7fb3240c7550 2024-04-25T13:16:44.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fe671ffb640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe66006c9f0 0x7fe66006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed09b6b640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fed041583f0 con 0x7fed0415b400 2024-04-25T13:16:44.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed09b6b640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed04158110 con 0x7fed040cd290 2024-04-25T13:16:44.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed09b6b640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fed0406cab0 con 0x7fed04152060 2024-04-25T13:16:44.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f38a00dc640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389815a420 con 0x7f38980c2780 2024-04-25T13:16:44.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fb31a7fc640 1 -- 172.21.15.26:0/3216892010 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb320011890 con 0x7fb3240c7550 2024-04-25T13:16:44.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fb31a7fc640 1 -- 172.21.15.26:0/3216892010 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320011c40 con 0x7fb3240c7550 2024-04-25T13:16:44.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fe671ffb640 1 -- 172.21.15.26:0/1560035275 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe66c08c150 con 0x7fe67c06e850 2024-04-25T13:16:44.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f51b77fe640 1 -- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b80b5450 msgr2=0x7f51b8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f51b77fe640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b80b5450 0x7f51b8157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f51b77fe640 1 -- 172.21.15.26:0/3638493043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b3c00 msgr2=0x7f51b815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f51b77fe640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b3c00 0x7f51b815d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f51b77fe640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b815c2b0 con 0x7f51b81554e0 2024-04-25T13:16:44.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f2926ffd640 1 -- 172.21.15.26:0/3161301908 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f292c0179d0 con 0x7f2930206170 2024-04-25T13:16:44.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f4b8ffff640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b901ed0f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009c10 tx=0x7f4b80004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f4b8cff9640 1 -- 172.21.15.26:0/1581889647 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80036070 con 0x7f4b780039b0 2024-04-25T13:16:44.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fe680856640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe66006c9f0 0x7fe66006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7f4b8cff9640 1 -- 172.21.15.26:0/1581889647 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80041070 con 0x7f4b780039b0 2024-04-25T13:16:44.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f51b77fe640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b81554e0 0x7f51b81f1d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51b806bcb0 tx=0x7f51b0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed08b69640 1 -- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed04152060 msgr2=0x7fed040cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed08b69640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed04152060 0x7fed040cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fed08b69640 1 -- 172.21.15.26:0/695983866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 msgr2=0x7fed041ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.253+0000 7fb32c219640 1 -- 172.21.15.26:0/3216892010 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb324157f50 con 0x7fb3240c7550 2024-04-25T13:16:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7fb32c219640 1 -- 172.21.15.26:0/3216892010 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3241581d0 con 0x7fb3240c7550 2024-04-25T13:16:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7fed08b69640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed041ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7fed08b69640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed041eff50 con 0x7fed040cd290 2024-04-25T13:16:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f2926ffd640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f291406c9c0 0x7f291406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7fed0936a640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed041ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f2926ffd640 1 -- 172.21.15.26:0/3161301908 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f292c08bfa0 con 0x7f2930206170 2024-04-25T13:16:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7fef1dbdf640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7feefc06c9c0 0x7feefc06ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef14001770 tx=0x7fef14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f2936374640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f291406c9c0 0x7f291406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7fe680856640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe66006c9f0 0x7fe66006eeb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0cd0d0 tx=0x7fe678006b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f388e7fc640 1 -- 172.21.15.26:0/3185047842 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f388801a070 con 0x7f38980c2780 2024-04-25T13:16:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7fed08b69640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed040cd290 0x7fed040c8ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c460 tx=0x7fecf800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f4b8cff9640 1 -- 172.21.15.26:0/1581889647 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80003e20 con 0x7f4b780039b0 2024-04-25T13:16:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b901ed730 con 0x7f4b780039b0 2024-04-25T13:16:44.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.254+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b901edcf0 con 0x7f4b780039b0 2024-04-25T13:16:44.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.255+0000 7f388e7fc640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f387c06c9c0 0x7f387c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.255+0000 7f388e7fc640 1 -- 172.21.15.26:0/3185047842 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f388808b2e0 con 0x7f38980c2780 2024-04-25T13:16:44.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.255+0000 7fb32c219640 1 -- 172.21.15.26:0/3216892010 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb324068cc0 con 0x7fb3240c7550 2024-04-25T13:16:44.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.255+0000 7f389d677640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f387c06c9c0 0x7f387c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.256+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90068e40 con 0x7f4b780039b0 2024-04-25T13:16:44.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.256+0000 7f2936374640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f291406c9c0 0x7f291406ee80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2920001880 tx=0x7f2920001670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.256+0000 7f389d677640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f387c06c9c0 0x7f387c06ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3894034000 tx=0x7f389402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.256+0000 7fb31a7fc640 1 -- 172.21.15.26:0/3216892010 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb320018020 con 0x7fb3240c7550 2024-04-25T13:16:44.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.256+0000 7f4b8cff9640 1 -- 172.21.15.26:0/1581889647 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b8003c420 con 0x7f4b780039b0 2024-04-25T13:16:44.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fb31a7fc640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb30806c940 0x7fb30806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f4b8cff9640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4b7c06c940 0x7f4b7c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fb31a7fc640 1 -- 172.21.15.26:0/3216892010 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb32008be60 con 0x7fb3240c7550 2024-04-25T13:16:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fb329fb5640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb30806c940 0x7fb30806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fed017fa640 1 -- 172.21.15.26:0/695983866 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8005ce0 con 0x7fed040cd290 2024-04-25T13:16:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fed09b6b640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed041f01f0 con 0x7fed040cd290 2024-04-25T13:16:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fed017fa640 1 -- 172.21.15.26:0/695983866 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf8007070 con 0x7fed040cd290 2024-04-25T13:16:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f519f7fe640 1 -- 172.21.15.26:0/3638493043 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0031b40 con 0x7f51b81554e0 2024-04-25T13:16:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4b7c06c940 0x7f4b7c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fed017fa640 1 -- 172.21.15.26:0/695983866 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8007460 con 0x7fed040cd290 2024-04-25T13:16:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f519f7fe640 1 -- 172.21.15.26:0/3638493043 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b0044070 con 0x7f51b81554e0 2024-04-25T13:16:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f519f7fe640 1 -- 172.21.15.26:0/3638493043 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b003c420 con 0x7f51b81554e0 2024-04-25T13:16:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b8156950 con 0x7f51b81554e0 2024-04-25T13:16:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b815c550 con 0x7f51b81554e0 2024-04-25T13:16:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7fed09b6b640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed041f07b0 con 0x7fed040cd290 2024-04-25T13:16:44.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.257+0000 7f2926ffd640 1 -- 172.21.15.26:0/3161301908 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f292c01d060 con 0x7f2930206170 2024-04-25T13:16:44.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.258+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4b7c06c940 0x7f4b7c06ee00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b901ead20 tx=0x7f4b84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.258+0000 7fed09b6b640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed04069310 con 0x7fed040cd290 2024-04-25T13:16:44.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.259+0000 7fb329fb5640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb30806c940 0x7fb30806ee00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb31c034000 tx=0x7fb31c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.259+0000 7fed017fa640 1 -- 172.21.15.26:0/695983866 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecf8007600 con 0x7fed040cd290 2024-04-25T13:16:44.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.259+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b8068e40 con 0x7f51b81554e0 2024-04-25T13:16:44.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.259+0000 7fed017fa640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fecf006c8f0 0x7fecf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.259+0000 7fed017fa640 1 -- 172.21.15.26:0/695983866 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fecf808bb80 con 0x7fed040cd290 2024-04-25T13:16:44.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.259+0000 7fed03fff640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fecf006c8f0 0x7fecf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.260+0000 7f519f7fe640 1 -- 172.21.15.26:0/3638493043 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51b0039040 con 0x7f51b81554e0 2024-04-25T13:16:44.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.260+0000 7fe671ffb640 1 -- 172.21.15.26:0/1560035275 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe67c158250 con 0x7fe67c06e850 2024-04-25T13:16:44.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.260+0000 7fed03fff640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fecf006c8f0 0x7fecf006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fecf4036000 tx=0x7fecf400b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.260+0000 7f519f7fe640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f51a406c8f0 0x7f51a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:44.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.260+0000 7f519f7fe640 1 -- 172.21.15.26:0/3638493043 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f51b00acf50 con 0x7f51b81554e0 2024-04-25T13:16:44.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.260+0000 7f51b6ffd640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f51a406c8f0 0x7f51a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:44.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.261+0000 7f4b8cff9640 1 -- 172.21.15.26:0/1581889647 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b80077720 con 0x7f4b780039b0 2024-04-25T13:16:44.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.261+0000 7f51b6ffd640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f51a406c8f0 0x7f51a406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0094a0 tx=0x7f51ac009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:44.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.261+0000 7f388e7fc640 1 -- 172.21.15.26:0/3185047842 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f389815a420 con 0x7f38980c2780 2024-04-25T13:16:44.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.264+0000 7fed017fa640 1 -- 172.21.15.26:0/695983866 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fecf80594f0 con 0x7fed040cd290 2024-04-25T13:16:44.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.266+0000 7fb31a7fc640 1 -- 172.21.15.26:0/3216892010 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb32001f020 con 0x7fb3240c7550 2024-04-25T13:16:44.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.269+0000 7f519f7fe640 1 -- 172.21.15.26:0/3638493043 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51b007a8c0 con 0x7f51b81554e0 2024-04-25T13:16:44.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.269+0000 7fef0e7fc640 1 -- 172.21.15.26:0/2749110475 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef08058a40 con 0x7fef181595d0 2024-04-25T13:16:44.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.273+0000 7f4b8cff9640 1 -- 172.21.15.26:0/1581889647 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b8004a020 con 0x7f4b780039b0 2024-04-25T13:16:44.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.689+0000 7f2924ff9640 1 -- 172.21.15.26:0/3161301908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2930073800 con 0x7f2930206170 2024-04-25T13:16:44.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.690+0000 7f2926ffd640 1 -- 172.21.15.26:0/3161301908 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f292c059a20 con 0x7f2930206170 2024-04-25T13:16:44.691 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.693+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f291406c9c0 msgr2=0x7f291406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.693+0000 7f29385d8640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f291406c9c0 0x7f291406ee80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2920001880 tx=0x7f2920001670 comp rx=0 tx=0).stop 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930206170 msgr2=0x7f2930206620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930206170 0x7f2930206620 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f293006dd80 tx=0x7f292c00eba0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 shutdown_connections 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f291406c9c0 0x7f291406ee80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930206170 0x7f2930206620 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29301615b0 0x7f2930166460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 --2- 172.21.15.26:0/3161301908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f291c004800 0x7f29301f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 >> 172.21.15.26:0/3161301908 conn(0x7f29300c8f00 msgr2=0x7f2930167570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.694+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 shutdown_connections 2024-04-25T13:16:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.695+0000 7f29385d8640 1 -- 172.21.15.26:0/3161301908 wait complete. 2024-04-25T13:16:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.695+0000 7f38a00dc640 1 -- 172.21.15.26:0/3185047842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f38980ca5f0 con 0x7f38980c2780 2024-04-25T13:16:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.696+0000 7f388e7fc640 1 -- 172.21.15.26:0/3185047842 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38980ca5f0 con 0x7f38980c2780 2024-04-25T13:16:44.697 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:44.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 -- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f387c06c9c0 msgr2=0x7f387c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f387c06c9c0 0x7f387c06ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3894034000 tx=0x7f389402c000 comp rx=0 tx=0).stop 2024-04-25T13:16:44.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 -- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38980c2780 msgr2=0x7f38981e5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38980c2780 0x7f38981e5dc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f388800c400 tx=0x7f388800c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 -- 172.21.15.26:0/3185047842 shutdown_connections 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f387c06c9c0 0x7f387c06ee80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38981601d0 0x7f389815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38981598b0 0x7f389815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.700+0000 7f387bfff640 1 --2- 172.21.15.26:0/3185047842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38980c2780 0x7f38981e5dc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.701+0000 7f387bfff640 1 -- 172.21.15.26:0/3185047842 >> 172.21.15.26:0/3185047842 conn(0x7f38980c9a70 msgr2=0x7f38980c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.701+0000 7f387bfff640 1 -- 172.21.15.26:0/3185047842 shutdown_connections 2024-04-25T13:16:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.701+0000 7f387bfff640 1 -- 172.21.15.26:0/3185047842 wait complete. 2024-04-25T13:16:44.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.702+0000 7fb32c219640 1 -- 172.21.15.26:0/3216892010 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb32415eec0 con 0x7fb3240c7550 2024-04-25T13:16:44.705 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:44.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.703+0000 7fb31a7fc640 1 -- 172.21.15.26:0/3216892010 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb324157f50 con 0x7fb3240c7550 2024-04-25T13:16:44.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.706+0000 7fb307fff640 1 -- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb30806c940 msgr2=0x7fb30806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb30806c940 0x7fb30806ee00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb31c034000 tx=0x7fb31c02f000 comp rx=0 tx=0).stop 2024-04-25T13:16:44.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fed09b6b640 1 -- 172.21.15.26:0/695983866 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fed04151880 con 0x7fed040cd290 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 -- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3240c7550 msgr2=0x7fb32414d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3240c7550 0x7fb32414d4b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb32000b450 tx=0x7fb32000b910 comp rx=0 tx=0).stop 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 -- 172.21.15.26:0/3216892010 shutdown_connections 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb30806c940 0x7fb30806ee00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3240c7930 0x7fb32414d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3240c7550 0x7fb32414d4b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 --2- 172.21.15.26:0/3216892010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3240c3e40 0x7fb32414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 -- 172.21.15.26:0/3216892010 >> 172.21.15.26:0/3216892010 conn(0x7fb32406eb20 msgr2=0x7fb3240c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 -- 172.21.15.26:0/3216892010 shutdown_connections 2024-04-25T13:16:44.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fed017fa640 1 -- 172.21.15.26:0/695983866 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fecf805d7f0 con 0x7fed040cd290 2024-04-25T13:16:44.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.707+0000 7fb307fff640 1 -- 172.21.15.26:0/3216892010 wait complete. 2024-04-25T13:16:44.710 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-25T13:16:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.710+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4b900cc760 con 0x7f4b780039b0 2024-04-25T13:16:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.710+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fef18068e40 con 0x7fef181595d0 2024-04-25T13:16:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.711+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe65c005850 con 0x7fe67c06e850 2024-04-25T13:16:44.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.711+0000 7fef0e7fc640 1 -- 172.21.15.26:0/2749110475 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fef0805cd40 con 0x7fef181595d0 2024-04-25T13:16:44.712 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:44.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.711+0000 7f4b8cff9640 1 -- 172.21.15.26:0/1581889647 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b80079680 con 0x7f4b780039b0 2024-04-25T13:16:44.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.711+0000 7feceaffd640 1 -- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fecf006c8f0 msgr2=0x7fecf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fecf006c8f0 0x7fecf006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fecf4036000 tx=0x7fecf400b000 comp rx=0 tx=0).stop 2024-04-25T13:16:44.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 -- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed040cd290 msgr2=0x7fed040c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed040cd290 0x7fed040c8ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c460 tx=0x7fecf800c920 comp rx=0 tx=0).stop 2024-04-25T13:16:44.713 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-25T13:16:44.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.711+0000 7fe671ffb640 1 -- 172.21.15.26:0/1560035275 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe66c05a220 con 0x7fe67c06e850 2024-04-25T13:16:44.714 INFO:teuthology.orchestra.run.smithi026.stdout:60129542155 2024-04-25T13:16:44.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 -- 172.21.15.26:0/695983866 shutdown_connections 2024-04-25T13:16:44.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fecf006c8f0 0x7fecf006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415b400 0x7fed041ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed04152060 0x7fed040cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 --2- 172.21.15.26:0/695983866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed040cd290 0x7fed040c8ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 -- 172.21.15.26:0/695983866 >> 172.21.15.26:0/695983866 conn(0x7fed040cc7a0 msgr2=0x7fed040737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2024-04-25T13:16:44.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.712+0000 7feceaffd640 1 -- 172.21.15.26:0/695983866 shutdown_connections 2024-04-25T13:16:44.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.713+0000 7feceaffd640 1 -- 172.21.15.26:0/695983866 wait complete. 2024-04-25T13:16:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4b7c06c940 msgr2=0x7f4b7c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4b7c06c940 0x7f4b7c06ee00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b901ead20 tx=0x7f4b84008040 comp rx=0 tx=0).stop 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 msgr2=0x7f4b901ed0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b901ed0f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009c10 tx=0x7f4b80004730 comp rx=0 tx=0).stop 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 shutdown_connections 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4b7c06c940 0x7f4b7c06ee00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b90151490 0x7f4b900cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b90151050 0x7f4b900d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 --2- 172.21.15.26:0/1581889647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b780039b0 0x7f4b901ed0f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 >> 172.21.15.26:0/1581889647 conn(0x7f4b90074d50 msgr2=0x7f4b900c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 shutdown_connections 2024-04-25T13:16:44.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.714+0000 7f4b969b4640 1 -- 172.21.15.26:0/1581889647 wait complete. 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe66006c9f0 msgr2=0x7fe66006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe66006c9f0 0x7fe66006eeb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0cd0d0 tx=0x7fe678006b30 comp rx=0 tx=0).stop 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe67c06e850 msgr2=0x7fe67c148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe67c06e850 0x7fe67c148540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00ebe0 tx=0x7fe66c00c520 comp rx=0 tx=0).stop 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7feefc06c9c0 msgr2=0x7feefc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7feefc06c9c0 0x7feefc06ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef14001770 tx=0x7fef14009040 comp rx=0 tx=0).stop 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef181595d0 msgr2=0x7fef18158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef181595d0 0x7fef18158000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c390 tx=0x7fef0800c790 comp rx=0 tx=0).stop 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 shutdown_connections 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe66006c9f0 0x7fe66006eeb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe67c0c8160 0x7fe67c0cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe67c06ec30 0x7fe67c148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 --2- 172.21.15.26:0/1560035275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe67c06e850 0x7fe67c148540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 >> 172.21.15.26:0/1560035275 conn(0x7fe67c0c8f00 msgr2=0x7fe67c14fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 shutdown_connections 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7feefc06c9c0 0x7feefc06ee80 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef14001770 tx=0x7fef14009040 comp rx=0 tx=0).stop 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef181595d0 0x7fef18158000 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef180c8df0 0x7fef18073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 --2- 172.21.15.26:0/2749110475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef180c38e0 0x7fef180cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 >> 172.21.15.26:0/2749110475 conn(0x7fef18074d50 msgr2=0x7fef18075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.715+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 shutdown_connections 2024-04-25T13:16:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.716+0000 7fe6832bb640 1 -- 172.21.15.26:0/1560035275 wait complete. 2024-04-25T13:16:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.716+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 shutdown_connections 2024-04-25T13:16:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.716+0000 7fef1fe43640 1 -- 172.21.15.26:0/2749110475 wait complete. 2024-04-25T13:16:44.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2024-04-25T13:16:44.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.723+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f51b8158ad0 con 0x7f51b81554e0 2024-04-25T13:16:44.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.723+0000 7f519f7fe640 1 -- 172.21.15.26:0/3638493043 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51b007ebc0 con 0x7f51b81554e0 2024-04-25T13:16:44.724 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f51a406c8f0 msgr2=0x7f51a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f51a406c8f0 0x7f51a406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0094a0 tx=0x7f51ac009240 comp rx=0 tx=0).stop 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b81554e0 msgr2=0x7f51b81f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b81554e0 0x7f51b81f1d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51b806bcb0 tx=0x7f51b0004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 shutdown_connections 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f51a406c8f0 0x7f51a406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b81554e0 0x7f51b81f1d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.727+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51b80b5450 0x7f51b8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.728+0000 7f51bd3ad640 1 --2- 172.21.15.26:0/3638493043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51b80b3c00 0x7f51b815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.728+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 >> 172.21.15.26:0/3638493043 conn(0x7f51b8074d50 msgr2=0x7f51b8151790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.728+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 shutdown_connections 2024-04-25T13:16:44.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:44.728+0000 7f51bd3ad640 1 -- 172.21.15.26:0/3638493043 wait complete. 2024-04-25T13:16:44.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.5 2024-04-25T13:16:44.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.4 2024-04-25T13:16:44.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-04-25T13:16:44.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2024-04-25T13:16:44.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-04-25T13:16:44.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2024-04-25T13:16:45.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:16:45.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:16:45.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:16:45.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:16:45.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:16:45.737 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:16:45.737 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:16:45.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:16:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.886+0000 7fb97064e640 1 Processor -- start 2024-04-25T13:16:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.886+0000 7fb97064e640 1 -- start start 2024-04-25T13:16:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.888+0000 7fb97064e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb96806f870 0x7fb9681570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.888+0000 7fb97064e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb96806ec30 0x7fb9680c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.888+0000 7fb97064e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9680c46b0 con 0x7fb96806e850 2024-04-25T13:16:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.888+0000 7fb97064e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb9680c4990 con 0x7fb96806f870 2024-04-25T13:16:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.888+0000 7fb97064e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb9680c4c70 con 0x7fb96806ec30 2024-04-25T13:16:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.889+0000 7fb96e3ea640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fb96806e850 0x7fb968150f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42604/0 (socket says 172.21.15.26:42604) 2024-04-25T13:16:45.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.889+0000 7fb96e3ea640 1 -- 172.21.15.26:0/3152706664 learned_addr learned my addr 172.21.15.26:0/3152706664 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:45.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.889+0000 7fb96dbe9640 1 --2- 172.21.15.26:0/3152706664 >> v2:172.21.15.26:3300/0 conn(0x7fb96806f870 0x7fb9681570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.889+0000 7fb96d3e8640 1 -- 172.21.15.26:0/3152706664 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453753292 0 0) 0x7fb9680c46b0 con 0x7fb96806e850 2024-04-25T13:16:45.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.889+0000 7fb96d3e8640 1 -- 172.21.15.26:0/3152706664 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb954003520 con 0x7fb96806e850 2024-04-25T13:16:45.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.890+0000 7fb96dbe9640 1 -- 172.21.15.26:0/3152706664 >> v2:172.21.15.169:3300/0 conn(0x7fb96806ec30 msgr2=0x7fb9680c5a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:45.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.890+0000 7fb96dbe9640 1 --2- 172.21.15.26:0/3152706664 >> v2:172.21.15.169:3300/0 conn(0x7fb96806ec30 0x7fb9680c5a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.890+0000 7fb96dbe9640 1 -- 172.21.15.26:0/3152706664 >> v1:172.21.15.169:6789/0 conn(0x7fb96806e850 legacy=0x7fb968150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.890+0000 7fb96dbe9640 1 -- 172.21.15.26:0/3152706664 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9680c4f50 con 0x7fb96806f870 2024-04-25T13:16:45.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.891+0000 7fb96dbe9640 1 --2- 172.21.15.26:0/3152706664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806f870 0x7fb9681570f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb968075fe0 tx=0x7fb96402c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dcb41adff69e6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.891+0000 7fb96d3e8640 1 -- 172.21.15.26:0/3152706664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964036020 con 0x7fb96806f870 2024-04-25T13:16:45.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.891+0000 7fb96d3e8640 1 -- 172.21.15.26:0/3152706664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb964032680 con 0x7fb96806f870 2024-04-25T13:16:45.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.892+0000 7fb97064e640 1 -- 172.21.15.26:0/3152706664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806f870 msgr2=0x7fb9681570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.892+0000 7fb97064e640 1 --2- 172.21.15.26:0/3152706664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806f870 0x7fb9681570f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb968075fe0 tx=0x7fb96402c990 comp rx=0 tx=0).stop 2024-04-25T13:16:45.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.893+0000 7fb97064e640 1 -- 172.21.15.26:0/3152706664 shutdown_connections 2024-04-25T13:16:45.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.893+0000 7fb97064e640 1 --2- 172.21.15.26:0/3152706664 >> v2:172.21.15.169:3300/0 conn(0x7fb96806ec30 0x7fb9680c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.893+0000 7fb97064e640 1 --2- 172.21.15.26:0/3152706664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806f870 0x7fb9681570f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.893+0000 7fb97064e640 1 -- 172.21.15.26:0/3152706664 >> 172.21.15.26:0/3152706664 conn(0x7fb9680c8f00 msgr2=0x7fb9680c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.893+0000 7fb97064e640 1 -- 172.21.15.26:0/3152706664 shutdown_connections 2024-04-25T13:16:45.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.893+0000 7fb97064e640 1 -- 172.21.15.26:0/3152706664 wait complete. 2024-04-25T13:16:45.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.895+0000 7fb97064e640 1 Processor -- start 2024-04-25T13:16:45.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.895+0000 7fb97064e640 1 -- start start 2024-04-25T13:16:45.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.896+0000 7fb97064e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806e850 0x7fb9681582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.897+0000 7fb96e3ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806e850 0x7fb9681582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.897+0000 7fb96e3ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806e850 0x7fb9681582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52248/0 (socket says 172.21.15.26:52248) 2024-04-25T13:16:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.897+0000 7fb96e3ea640 1 -- 172.21.15.26:0/797430262 learned_addr learned my addr 172.21.15.26:0/797430262 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.897+0000 7fb97064e640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96806ec30 0x7fb968153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.897+0000 7fb97064e640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb96806f870 0x7fb9681544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.897+0000 7fb97064e640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb968151610 con 0x7fb96806e850 2024-04-25T13:16:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.897+0000 7fb97064e640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9680c5510 con 0x7fb96806ec30 2024-04-25T13:16:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.898+0000 7fb97064e640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb968151790 con 0x7fb96806f870 2024-04-25T13:16:45.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.898+0000 7fb96e3ea640 1 -- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb96806f870 msgr2=0x7fb9681544c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:16:45.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.898+0000 7fb96e3ea640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb96806f870 0x7fb9681544c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.898+0000 7fb96e3ea640 1 -- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96806ec30 msgr2=0x7fb968153f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:45.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.898+0000 7fb96e3ea640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96806ec30 0x7fb968153f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.898+0000 7fb96e3ea640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb968158960 con 0x7fb96806e850 2024-04-25T13:16:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.899+0000 7fb96e3ea640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806e850 0x7fb9681582b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb960001ce0 tx=0x7fb9600021a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.899+0000 7fb95effd640 1 -- 172.21.15.26:0/797430262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960018070 con 0x7fb96806e850 2024-04-25T13:16:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.900+0000 7fb97064e640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb968158c40 con 0x7fb96806e850 2024-04-25T13:16:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.902+0000 7fb97064e640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb968153780 con 0x7fb96806e850 2024-04-25T13:16:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.903+0000 7fb95effd640 1 -- 172.21.15.26:0/797430262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb960008390 con 0x7fb96806e850 2024-04-25T13:16:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.904+0000 7fb95effd640 1 -- 172.21.15.26:0/797430262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96000da40 con 0x7fb96806e850 2024-04-25T13:16:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.904+0000 7fb95effd640 1 -- 172.21.15.26:0/797430262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb96001b070 con 0x7fb96806e850 2024-04-25T13:16:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.905+0000 7fb95effd640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb94c06ca20 0x7fb94c06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.905+0000 7fb95effd640 1 -- 172.21.15.26:0/797430262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb96008b550 con 0x7fb96806e850 2024-04-25T13:16:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.907+0000 7fb97064e640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb950005290 con 0x7fb96806e850 2024-04-25T13:16:45.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.917+0000 7fb95effd640 1 -- 172.21.15.26:0/797430262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb960059680 con 0x7fb96806e850 2024-04-25T13:16:45.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.923+0000 7fb96dbe9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb94c06ca20 0x7fb94c06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.924+0000 7fb96dbe9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb94c06ca20 0x7fb94c06eee0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb964037000 tx=0x7fb964032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7f39c7fff640 1 Processor -- start 2024-04-25T13:16:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7ff8b9c60640 1 Processor -- start 2024-04-25T13:16:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7f18da859640 1 Processor -- start 2024-04-25T13:16:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7f938e21a640 1 Processor -- start 2024-04-25T13:16:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7f39c7fff640 1 -- start start 2024-04-25T13:16:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7f938e21a640 1 -- start start 2024-04-25T13:16:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7fda50ca6640 1 Processor -- start 2024-04-25T13:16:45.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7fda22edb640 1 Processor -- start 2024-04-25T13:16:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7fda50ca6640 1 -- start start 2024-04-25T13:16:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f0d25306640 1 Processor -- start 2024-04-25T13:16:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7f18da859640 1 -- start start 2024-04-25T13:16:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f18da859640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18d41554e0 0x7f18d415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.943+0000 7ff8b9c60640 1 -- start start 2024-04-25T13:16:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7ff8b9c60640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff8ac0d6b20 0x7ff8ac0dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7ff8b9c60640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff8ac0de070 0x7ff8ac0de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7ff8b9c60640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ac0dea20 con 0x7ff8ac005e80 2024-04-25T13:16:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7ff8b3fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff8ac005e80 0x7ff8ac04d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42612/0 (socket says 172.21.15.26:42612) 2024-04-25T13:16:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7ff8b3fff640 1 -- 172.21.15.26:0/815574395 learned_addr learned my addr 172.21.15.26:0/815574395 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7ff8b9c60640 1 -- 172.21.15.26:0/815574395 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff8ac0074b0 con 0x7ff8ac0de070 2024-04-25T13:16:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f938e21a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f93800dd3b0 0x7f9380046450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f938e21a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f938004ba50 0x7f938004be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f938e21a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93800dd790 con 0x7f93800e3080 2024-04-25T13:16:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f938e21a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9380045440 con 0x7f93800dd3b0 2024-04-25T13:16:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f938e21a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9380045fc0 con 0x7f938004ba50 2024-04-25T13:16:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f18da859640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18d40b3c00 0x7f18d40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f18d3fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18d41554e0 0x7f18d415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f18d3fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18d41554e0 0x7f18d415f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:37106/0 (socket says 172.21.15.26:37106) 2024-04-25T13:16:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f18d3fff640 1 -- 172.21.15.26:0/4067157996 learned_addr learned my addr 172.21.15.26:0/4067157996 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c00d5200 0x7f39c004b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7ff8b9c60640 1 -- 172.21.15.26:0/815574395 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff8ac0062f0 con 0x7ff8ac0d6b20 2024-04-25T13:16:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39c0005e90 0x7f39c0045330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f938ca17640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f938004ba50 0x7f938004be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f938ca17640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f938004ba50 0x7f938004be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58812/0 (socket says 172.21.15.26:58812) 2024-04-25T13:16:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f938ca17640 1 -- 172.21.15.26:0/1972665818 learned_addr learned my addr 172.21.15.26:0/1972665818 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c7fff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c0045ed0 con 0x7f39c004b090 2024-04-25T13:16:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7fda50ca6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda440d7020 0x7fda4404c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c7fff640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f39c0046f30 con 0x7f39c0005e90 2024-04-25T13:16:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c7fff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f39c0046170 con 0x7f39c00d5200 2024-04-25T13:16:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39c0005e90 0x7f39c0045330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f18d37fe640 1 --2- 172.21.15.26:0/4067157996 >> v2:172.21.15.26:3300/0 conn(0x7f18d40b3c00 0x7f18d40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39c0005e90 0x7f39c0045330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52276/0 (socket says 172.21.15.26:52276) 2024-04-25T13:16:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7ff8b8c5e640 1 --2- 172.21.15.26:0/815574395 >> v2:172.21.15.169:3300/0 conn(0x7ff8ac0d6b20 0x7ff8ac0dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7ff8b945f640 1 --2- 172.21.15.26:0/815574395 >> v2:172.21.15.26:3300/0 conn(0x7ff8ac0de070 0x7ff8ac0de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7fda22edb640 1 -- start start 2024-04-25T13:16:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f0d25306640 1 -- start start 2024-04-25T13:16:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c77fe640 1 -- 172.21.15.26:0/2677364207 learned_addr learned my addr 172.21.15.26:0/2677364207 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f938d218640 1 --2- 172.21.15.26:0/1972665818 >> v2:172.21.15.26:3300/0 conn(0x7f93800dd3b0 0x7f9380046450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f0d25306640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d180d9250 0x7f0d18039e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f0d25306640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1803a4b0 con 0x7f0d1804ffd0 2024-04-25T13:16:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f0d25306640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1804ef30 con 0x7f0d180e0490 2024-04-25T13:16:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f0d25306640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f0d1804f210 con 0x7f0d180d9250 2024-04-25T13:16:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.944+0000 7f18da859640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d41558c0 con 0x7f18d40b5450 2024-04-25T13:16:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f18da859640 1 -- 172.21.15.26:0/4067157996 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f18d40b4a80 con 0x7f18d40b3c00 2024-04-25T13:16:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f18da859640 1 -- 172.21.15.26:0/4067157996 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f18d415f630 con 0x7f18d41554e0 2024-04-25T13:16:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7f39c67fc640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f39c004b090 0x7f39c00db830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42624/0 (socket says 172.21.15.26:42624) 2024-04-25T13:16:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7fda22edb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda140d7020 0x7fda140dd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda50ca6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda440e0cd0 0x7fda440dd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda50ca6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda4404bb80 con 0x7fda440e0890 2024-04-25T13:16:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda50ca6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fda44034cd0 con 0x7fda440d7020 2024-04-25T13:16:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda50ca6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fda4404b930 con 0x7fda440e0cd0 2024-04-25T13:16:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda4b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda440d7020 0x7fda4404c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f937ffff640 1 -- 172.21.15.26:0/1972665818 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109413605 0 0) 0x7f9388074ad0 con 0x7f93800e3080 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f937ffff640 1 -- 172.21.15.26:0/1972665818 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9374003520 con 0x7f93800e3080 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f938ca17640 1 -- 172.21.15.26:0/1972665818 >> v2:172.21.15.26:3300/0 conn(0x7f93800dd3b0 msgr2=0x7f9380046450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f938ca17640 1 --2- 172.21.15.26:0/1972665818 >> v2:172.21.15.26:3300/0 conn(0x7f93800dd3b0 0x7f9380046450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f938ca17640 1 -- 172.21.15.26:0/1972665818 >> v1:172.21.15.169:6789/0 conn(0x7f93800e3080 legacy=0x7f93800e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f938ca17640 1 -- 172.21.15.26:0/1972665818 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93800e3e80 con 0x7f938004ba50 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f0d1f7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f0d180e0490 0x7f0d180071b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:42642/0 (socket says 172.21.15.26:42642) 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f0d1f7fe640 1 -- 172.21.15.26:0/895822394 learned_addr learned my addr 172.21.15.26:0/895822394 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda4b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda440d7020 0x7fda4404c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52294/0 (socket says 172.21.15.26:52294) 2024-04-25T13:16:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda4b7fe640 1 -- 172.21.15.26:0/3872965003 learned_addr learned my addr 172.21.15.26:0/3872965003 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f18d3fff640 1 -- 172.21.15.26:0/4067157996 >> v2:172.21.15.26:3300/0 conn(0x7f18d40b3c00 msgr2=0x7f18d40b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f18d3fff640 1 --2- 172.21.15.26:0/4067157996 >> v2:172.21.15.26:3300/0 conn(0x7f18d40b3c00 0x7f18d40b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f18d3fff640 1 -- 172.21.15.26:0/4067157996 >> v1:172.21.15.169:6789/0 conn(0x7f18d40b5450 legacy=0x7f18d40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f18d3fff640 1 -- 172.21.15.26:0/4067157996 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d40cb8c0 con 0x7f18d41554e0 2024-04-25T13:16:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f0d1ffff640 1 --2- 172.21.15.26:0/895822394 >> v2:172.21.15.26:3300/0 conn(0x7f0d180d9250 0x7f0d18039e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7ff8b8c5e640 1 -- 172.21.15.26:0/815574395 >> v2:172.21.15.26:3300/0 conn(0x7ff8ac0de070 msgr2=0x7ff8ac0de4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7fda22edb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda14047a10 0x7fda1404ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.945+0000 7fda22edb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda1404f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda216d8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda14047a10 0x7fda1404ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda216d8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda14047a10 0x7fda1404ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:37124/0 (socket says 172.21.15.26:37124) 2024-04-25T13:16:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda21ed9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda140d7020 0x7fda140dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda21ed9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda140d7020 0x7fda140dd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52306/0 (socket says 172.21.15.26:52306) 2024-04-25T13:16:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda22edb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fda1404e5c0 con 0x7fda140d7020 2024-04-25T13:16:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7ff8b8c5e640 1 --2- 172.21.15.26:0/815574395 >> v2:172.21.15.26:3300/0 conn(0x7ff8ac0de070 0x7ff8ac0de4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7ff8b8c5e640 1 -- 172.21.15.26:0/815574395 >> v1:172.21.15.169:6789/0 conn(0x7ff8ac005e80 legacy=0x7ff8ac04d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f0d1ffff640 1 -- 172.21.15.26:0/895822394 >> v1:172.21.15.169:6789/0 conn(0x7f0d180e0490 legacy=0x7f0d180071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f0d1ffff640 1 -- 172.21.15.26:0/895822394 >> v1:172.21.15.26:6789/0 conn(0x7f0d1804ffd0 legacy=0x7f0d180e98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7f0d1ffff640 1 -- 172.21.15.26:0/895822394 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1804f4f0 con 0x7f0d180d9250 2024-04-25T13:16:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda22edb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fda1404e810 con 0x7fda14047a10 2024-04-25T13:16:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.946+0000 7fda22edb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fda1404eaf0 con 0x7fda14047330 2024-04-25T13:16:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda216d8640 1 -- 172.21.15.26:0/1264981309 learned_addr learned my addr 172.21.15.26:0/1264981309 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda226da640 1 --2- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda1404f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7ff8b37fe640 1 -- 172.21.15.26:0/815574395 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772130762 0 0) 0x7ff8ac0dea20 con 0x7ff8ac005e80 2024-04-25T13:16:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7ff8b8c5e640 1 -- 172.21.15.26:0/815574395 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac0065c0 con 0x7ff8ac0d6b20 2024-04-25T13:16:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f18d3fff640 1 --2- 172.21.15.26:0/4067157996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415f0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18d408e520 tx=0x7f18cc02a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4fb6ff3bafba37d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda4b7fe640 1 -- 172.21.15.26:0/3872965003 >> v2:172.21.15.169:3300/0 conn(0x7fda440e0cd0 msgr2=0x7fda440dd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda4b7fe640 1 --2- 172.21.15.26:0/3872965003 >> v2:172.21.15.169:3300/0 conn(0x7fda440e0cd0 0x7fda440dd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda4b7fe640 1 -- 172.21.15.26:0/3872965003 >> v1:172.21.15.26:6789/0 conn(0x7fda440e0890 legacy=0x7fda440dca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda4b7fe640 1 -- 172.21.15.26:0/3872965003 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4404be60 con 0x7fda440d7020 2024-04-25T13:16:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f39c77fe640 1 -- 172.21.15.26:0/2677364207 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c00d5200 msgr2=0x7f39c004b620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f39c77fe640 1 --2- 172.21.15.26:0/2677364207 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c00d5200 0x7f39c004b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f18d2ffd640 1 -- 172.21.15.26:0/4067157996 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0325f0 con 0x7f18d41554e0 2024-04-25T13:16:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f18d2ffd640 1 -- 172.21.15.26:0/4067157996 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18cc032790 con 0x7f18d41554e0 2024-04-25T13:16:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f18d2ffd640 1 -- 172.21.15.26:0/4067157996 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc032ba0 con 0x7f18d41554e0 2024-04-25T13:16:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f39c77fe640 1 -- 172.21.15.26:0/2677364207 >> v1:172.21.15.169:6789/0 conn(0x7f39c004b090 legacy=0x7f39c00db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7f39c77fe640 1 -- 172.21.15.26:0/2677364207 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c0046450 con 0x7f39c0005e90 2024-04-25T13:16:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f938ca17640 1 --2- 172.21.15.26:0/1972665818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f938004ba50 0x7f938004be70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9378009870 tx=0x7f937802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01cab58d3fb78b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f0d1ffff640 1 --2- 172.21.15.26:0/895822394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180d9250 0x7f0d18039e70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0d2006ab50 tx=0x7f0d200a6650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edad04f43d9fb51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda216d8640 1 -- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 msgr2=0x7fda1404f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda216d8640 1 --2- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda1404f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda216d8640 1 -- 172.21.15.26:0/1264981309 >> v2:172.21.15.26:3300/0 conn(0x7fda140d7020 msgr2=0x7fda140dd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda216d8640 1 --2- 172.21.15.26:0/1264981309 >> v2:172.21.15.26:3300/0 conn(0x7fda140d7020 0x7fda140dd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda216d8640 1 -- 172.21.15.26:0/1264981309 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1404d280 con 0x7fda14047a10 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda21ed9640 1 --2- 172.21.15.26:0/1264981309 >> v2:172.21.15.26:3300/0 conn(0x7fda140d7020 0x7fda140dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.947+0000 7fda226da640 1 --2- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda1404f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f937ffff640 1 -- 172.21.15.26:0/1972665818 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378037070 con 0x7f938004ba50 2024-04-25T13:16:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f937ffff640 1 -- 172.21.15.26:0/1972665818 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378032440 con 0x7f938004ba50 2024-04-25T13:16:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7ff8b8c5e640 1 --2- 172.21.15.26:0/815574395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 0x7ff8ac0dcb80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00a6b0 tx=0x7ff8a002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d952a8ae1e4d3c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f937ffff640 1 -- 172.21.15.26:0/1972665818 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378032810 con 0x7f938004ba50 2024-04-25T13:16:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f0d1effd640 1 -- 172.21.15.26:0/895822394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200ab7d0 con 0x7f0d180d9250 2024-04-25T13:16:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f0d1effd640 1 -- 172.21.15.26:0/895822394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d200ab970 con 0x7f0d180d9250 2024-04-25T13:16:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f18da859640 1 -- 172.21.15.26:0/4067157996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 msgr2=0x7f18d415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7f18da859640 1 --2- 172.21.15.26:0/4067157996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415f0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18d408e520 tx=0x7f18cc02a780 comp rx=0 tx=0).stop 2024-04-25T13:16:45.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.948+0000 7fda216d8640 1 --2- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda14047a10 0x7fda1404ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda1404ff70 tx=0x7fda0c02a0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99cea1af3279f48b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f39c77fe640 1 --2- 172.21.15.26:0/2677364207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c0045330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39c807c7a0 tx=0x7f39c80aac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc801ccd4bfcfd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7ff8b37fe640 1 -- 172.21.15.26:0/815574395 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0037070 con 0x7ff8ac0d6b20 2024-04-25T13:16:45.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7ff8b37fe640 1 -- 172.21.15.26:0/815574395 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a0032440 con 0x7ff8ac0d6b20 2024-04-25T13:16:45.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7ff8b37fe640 1 -- 172.21.15.26:0/815574395 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0032810 con 0x7ff8ac0d6b20 2024-04-25T13:16:45.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7fda20ed7640 1 -- 172.21.15.26:0/1264981309 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c037070 con 0x7fda14047a10 2024-04-25T13:16:45.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7fda20ed7640 1 -- 172.21.15.26:0/1264981309 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c02ae10 con 0x7fda14047a10 2024-04-25T13:16:45.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f938e21a640 1 -- 172.21.15.26:0/1972665818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f938004ba50 msgr2=0x7f938004be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f938e21a640 1 --2- 172.21.15.26:0/1972665818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f938004ba50 0x7f938004be70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9378009870 tx=0x7f937802a250 comp rx=0 tx=0).stop 2024-04-25T13:16:45.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7fda4b7fe640 1 --2- 172.21.15.26:0/3872965003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440d7020 0x7fda4404c470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda4404e010 tx=0x7fda4002a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f02f6b5fb22024 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f18da859640 1 -- 172.21.15.26:0/4067157996 shutdown_connections 2024-04-25T13:16:45.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f18da859640 1 --2- 172.21.15.26:0/4067157996 >> v2:172.21.15.26:3300/0 conn(0x7f18d40b3c00 0x7f18d40b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f18da859640 1 --2- 172.21.15.26:0/4067157996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415f0f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f39c5ffb640 1 -- 172.21.15.26:0/2677364207 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c80ac970 con 0x7f39c0005e90 2024-04-25T13:16:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f18da859640 1 -- 172.21.15.26:0/4067157996 >> 172.21.15.26:0/4067157996 conn(0x7f18d4074d50 msgr2=0x7f18d4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f0d25306640 1 -- 172.21.15.26:0/895822394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180d9250 msgr2=0x7f0d18039e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f0d25306640 1 --2- 172.21.15.26:0/895822394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180d9250 0x7f0d18039e70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0d2006ab50 tx=0x7f0d200a6650 comp rx=0 tx=0).stop 2024-04-25T13:16:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f39c5ffb640 1 -- 172.21.15.26:0/2677364207 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c80acb10 con 0x7f39c0005e90 2024-04-25T13:16:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f39c5ffb640 1 -- 172.21.15.26:0/2677364207 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c80ad480 con 0x7f39c0005e90 2024-04-25T13:16:45.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f18da859640 1 -- 172.21.15.26:0/4067157996 shutdown_connections 2024-04-25T13:16:45.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.949+0000 7f18da859640 1 -- 172.21.15.26:0/4067157996 wait complete. 2024-04-25T13:16:45.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 -- 172.21.15.26:0/815574395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 msgr2=0x7ff8ac0dcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/815574395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 0x7ff8ac0dcb80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00a6b0 tx=0x7ff8a002a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7fda20ed7640 1 -- 172.21.15.26:0/1264981309 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c032660 con 0x7fda14047a10 2024-04-25T13:16:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7fda4a7fc640 1 -- 172.21.15.26:0/3872965003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40037070 con 0x7fda440d7020 2024-04-25T13:16:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7fda4a7fc640 1 -- 172.21.15.26:0/3872965003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda40032440 con 0x7fda440d7020 2024-04-25T13:16:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7fda4a7fc640 1 -- 172.21.15.26:0/3872965003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40032810 con 0x7fda440d7020 2024-04-25T13:16:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 -- 172.21.15.26:0/815574395 shutdown_connections 2024-04-25T13:16:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/815574395 >> v2:172.21.15.26:3300/0 conn(0x7ff8ac0de070 0x7ff8ac0de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/815574395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 0x7ff8ac0dcb80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 -- 172.21.15.26:0/815574395 >> 172.21.15.26:0/815574395 conn(0x7ff8ac04ee20 msgr2=0x7ff8ac04f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f938e21a640 1 -- 172.21.15.26:0/1972665818 shutdown_connections 2024-04-25T13:16:45.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f938e21a640 1 --2- 172.21.15.26:0/1972665818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f938004ba50 0x7f938004be70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f938e21a640 1 --2- 172.21.15.26:0/1972665818 >> v2:172.21.15.26:3300/0 conn(0x7f93800dd3b0 0x7f9380046450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f938e21a640 1 -- 172.21.15.26:0/1972665818 >> 172.21.15.26:0/1972665818 conn(0x7f9380050170 msgr2=0x7f9380050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 -- 172.21.15.26:0/815574395 shutdown_connections 2024-04-25T13:16:45.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7ff8b9c60640 1 -- 172.21.15.26:0/815574395 wait complete. 2024-04-25T13:16:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f938e21a640 1 -- 172.21.15.26:0/1972665818 shutdown_connections 2024-04-25T13:16:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f938e21a640 1 -- 172.21.15.26:0/1972665818 wait complete. 2024-04-25T13:16:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7fda22edb640 1 -- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda14047a10 msgr2=0x7fda1404ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7fda22edb640 1 --2- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda14047a10 0x7fda1404ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda1404ff70 tx=0x7fda0c02a0c0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f0d25306640 1 -- 172.21.15.26:0/895822394 shutdown_connections 2024-04-25T13:16:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f0d25306640 1 --2- 172.21.15.26:0/895822394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180d9250 0x7f0d18039e70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f0d25306640 1 -- 172.21.15.26:0/895822394 >> 172.21.15.26:0/895822394 conn(0x7f0d1800e160 msgr2=0x7f0d1800e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f39c7fff640 1 -- 172.21.15.26:0/2677364207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 msgr2=0x7f39c0045330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.950+0000 7f39c7fff640 1 --2- 172.21.15.26:0/2677364207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c0045330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39c807c7a0 tx=0x7f39c80aac10 comp rx=0 tx=0).stop 2024-04-25T13:16:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 -- 172.21.15.26:0/3872965003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440d7020 msgr2=0x7fda4404c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f39c7fff640 1 -- 172.21.15.26:0/2677364207 shutdown_connections 2024-04-25T13:16:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3872965003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440d7020 0x7fda4404c470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda4404e010 tx=0x7fda4002a2e0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f39c7fff640 1 --2- 172.21.15.26:0/2677364207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c0045330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f0d25306640 1 -- 172.21.15.26:0/895822394 shutdown_connections 2024-04-25T13:16:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f39c7fff640 1 --2- 172.21.15.26:0/2677364207 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c00d5200 0x7f39c004b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f39c7fff640 1 -- 172.21.15.26:0/2677364207 >> 172.21.15.26:0/2677364207 conn(0x7f39c0050180 msgr2=0x7f39c0050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 -- 172.21.15.26:0/3872965003 shutdown_connections 2024-04-25T13:16:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3872965003 >> v2:172.21.15.169:3300/0 conn(0x7fda440e0cd0 0x7fda440dd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3872965003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440d7020 0x7fda4404c470 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 -- 172.21.15.26:0/3872965003 >> 172.21.15.26:0/3872965003 conn(0x7fda44050180 msgr2=0x7fda44050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 -- 172.21.15.26:0/3872965003 shutdown_connections 2024-04-25T13:16:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f18da859640 1 Processor -- start 2024-04-25T13:16:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda50ca6640 1 -- 172.21.15.26:0/3872965003 wait complete. 2024-04-25T13:16:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f0d25306640 1 -- 172.21.15.26:0/895822394 wait complete. 2024-04-25T13:16:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f18da859640 1 -- start start 2024-04-25T13:16:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f39c7fff640 1 -- 172.21.15.26:0/2677364207 shutdown_connections 2024-04-25T13:16:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda22edb640 1 -- 172.21.15.26:0/1264981309 shutdown_connections 2024-04-25T13:16:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda22edb640 1 --2- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda1404f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda22edb640 1 --2- 172.21.15.26:0/1264981309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda14047a10 0x7fda1404ee00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda22edb640 1 --2- 172.21.15.26:0/1264981309 >> v2:172.21.15.26:3300/0 conn(0x7fda140d7020 0x7fda140dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7fda22edb640 1 -- 172.21.15.26:0/1264981309 >> 172.21.15.26:0/1264981309 conn(0x7fda14009e40 msgr2=0x7fda1400a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.951+0000 7f39c7fff640 1 -- 172.21.15.26:0/2677364207 wait complete. 2024-04-25T13:16:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f938e21a640 1 Processor -- start 2024-04-25T13:16:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f938e21a640 1 -- start start 2024-04-25T13:16:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7ff8b9c60640 1 Processor -- start 2024-04-25T13:16:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7fda22edb640 1 -- 172.21.15.26:0/1264981309 shutdown_connections 2024-04-25T13:16:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f18da859640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18d40b3c00 0x7f18d4150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f18da859640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18d40b5450 0x7f18d415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f0d25306640 1 Processor -- start 2024-04-25T13:16:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f18da859640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f18da859640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f18d40b4430 con 0x7f18d40b5450 2024-04-25T13:16:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f18da859640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f18d40b4150 con 0x7f18d41554e0 2024-04-25T13:16:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7f18da859640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f18d40b4710 con 0x7f18d40b3c00 2024-04-25T13:16:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.952+0000 7fda22edb640 1 -- 172.21.15.26:0/1264981309 wait complete. 2024-04-25T13:16:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18d40b3c00 0x7f18d4150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18d40b3c00 0x7f18d4150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58826/0 (socket says 172.21.15.26:58826) 2024-04-25T13:16:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d3fff640 1 -- 172.21.15.26:0/1495611564 learned_addr learned my addr 172.21.15.26:0/1495611564 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d37fe640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18d40b5450 0x7f18d415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d8df6640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7ff8b9c60640 1 -- start start 2024-04-25T13:16:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f938e21a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f938004ba50 0x7f938004f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d8df6640 1 -- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18d40b3c00 msgr2=0x7f18d4150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d8df6640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18d40b3c00 0x7f18d4150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d8df6640 1 -- 172.21.15.26:0/1495611564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18d40b5450 msgr2=0x7f18d415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d8df6640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18d40b5450 0x7f18d415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f18d8df6640 1 -- 172.21.15.26:0/1495611564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d415e650 con 0x7f18d41554e0 2024-04-25T13:16:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f0d25306640 1 -- start start 2024-04-25T13:16:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f938d218640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f938004ba50 0x7f938004f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.953+0000 7f938d218640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f938004ba50 0x7f938004f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52334/0 (socket says 172.21.15.26:52334) 2024-04-25T13:16:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f39c7fff640 1 Processor -- start 2024-04-25T13:16:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7fda22edb640 1 Processor -- start 2024-04-25T13:16:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938d218640 1 -- 172.21.15.26:0/986525744 learned_addr learned my addr 172.21.15.26:0/986525744 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93800dd3b0 0x7f93800d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7fda22edb640 1 -- start start 2024-04-25T13:16:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93800e3080 0x7f9380047be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f39c7fff640 1 -- start start 2024-04-25T13:16:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d25306640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d1804ffd0 0x7f0d18175720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938ca17640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93800dd3b0 0x7f93800d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d25306640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d180d9250 0x7f0d180df570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7fda50ca6640 1 Processor -- start 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9380045970 con 0x7f938004ba50 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d25306640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180e0490 0x7f0d18178210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d1f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d180d9250 0x7f0d180df570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d1f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d180d9250 0x7f0d180df570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58846/0 (socket says 172.21.15.26:58846) 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d1f7fe640 1 -- 172.21.15.26:0/1771731590 learned_addr learned my addr 172.21.15.26:0/1771731590 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18050420 con 0x7f0d180e0490 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1804fab0 con 0x7f0d1804ffd0 2024-04-25T13:16:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0d180d9630 con 0x7f0d180d9250 2024-04-25T13:16:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7ff8b9c60640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ac005e80 0x7ff8ac1789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938da19640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93800e3080 0x7f9380047be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7fda50ca6640 1 -- start start 2024-04-25T13:16:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93800e3c20 con 0x7f93800e3080 2024-04-25T13:16:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9380045c50 con 0x7f93800dd3b0 2024-04-25T13:16:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7ff8b9c60640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 0x7ff8ac04d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.954+0000 7ff8b9c60640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8ac0de070 0x7ff8ac0508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b9c60640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac006e60 con 0x7ff8ac005e80 2024-04-25T13:16:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b9c60640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac006b80 con 0x7ff8ac0d6b20 2024-04-25T13:16:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b9c60640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff8ac007140 con 0x7ff8ac0de070 2024-04-25T13:16:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ac005e80 0x7ff8ac1789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ac005e80 0x7ff8ac1789e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52346/0 (socket says 172.21.15.26:52346) 2024-04-25T13:16:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 -- 172.21.15.26:0/1567593674 learned_addr learned my addr 172.21.15.26:0/1567593674 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f0d24b05640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180e0490 0x7f0d18178210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda22edb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda140dce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda22edb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda14047a10 0x7fda140daa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda22edb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda140d7020 0x7fda14167250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 -- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8ac0de070 msgr2=0x7ff8ac0508f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda216d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda14047a10 0x7fda140daa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda216d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda14047a10 0x7fda140daa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52356/0 (socket says 172.21.15.26:52356) 2024-04-25T13:16:45.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8ac0de070 0x7ff8ac0508f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 -- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 msgr2=0x7ff8ac04d320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:16:45.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 0x7ff8ac04d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7ff8b8c5e640 1 -- 172.21.15.26:0/1567593674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac052680 con 0x7ff8ac005e80 2024-04-25T13:16:45.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda21ed9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda140dce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda216d8640 1 -- 172.21.15.26:0/624539623 learned_addr learned my addr 172.21.15.26:0/624539623 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fda140e0580 con 0x7fda14047a10 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f0d24b05640 1 -- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d180d9250 msgr2=0x7f0d180df570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f0d24b05640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d180d9250 0x7f0d180df570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f0d24b05640 1 -- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d1804ffd0 msgr2=0x7f0d18175720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f0d24b05640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d1804ffd0 0x7f0d18175720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f0d24b05640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1804b0f0 con 0x7f0d180e0490 2024-04-25T13:16:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f0d1f7fe640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d180d9250 0x7f0d180df570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda140e0400 con 0x7fda140d7020 2024-04-25T13:16:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7fda21ed9640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda140dce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58850/0 (socket says 172.21.15.26:58850) 2024-04-25T13:16:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c004b090 0x7f39c0049640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda226da640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda140d7020 0x7fda14167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f938d218640 1 -- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93800dd3b0 msgr2=0x7f93800d7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f938d218640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93800dd3b0 0x7f93800d7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.955+0000 7f938d218640 1 -- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93800e3080 msgr2=0x7f9380047be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fda140e0700 con 0x7fda14047330 2024-04-25T13:16:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f18d8df6640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415b140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18d40cc230 tx=0x7f18c400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c00cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52360/0 (socket says 172.21.15.26:52360) 2024-04-25T13:16:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c6ffd640 1 -- 172.21.15.26:0/1519626899 learned_addr learned my addr 172.21.15.26:0/1519626899 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f0d24b05640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180e0490 0x7f0d18178210 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c410 tx=0x7f0d1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c7fff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c00d5200 0x7f39c00dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c67fc640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c004b090 0x7f39c0049640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7ff8b8c5e640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ac005e80 0x7ff8ac1789e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009890 tx=0x7ff8a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f938d218640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93800e3080 0x7f9380047be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f938d218640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9380049de0 con 0x7f938004ba50 2024-04-25T13:16:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f18d0ff9640 1 -- 172.21.15.26:0/1495611564 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4017070 con 0x7f18d41554e0 2024-04-25T13:16:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f39c000e2a0 con 0x7f39c0005e90 2024-04-25T13:16:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f18d0ff9640 1 -- 172.21.15.26:0/1495611564 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c40052f0 con 0x7f18d41554e0 2024-04-25T13:16:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f18d0ff9640 1 -- 172.21.15.26:0/1495611564 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003850 con 0x7f18d41554e0 2024-04-25T13:16:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f938da19640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93800e3080 0x7f9380047be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0046a10 con 0x7f39c00d5200 2024-04-25T13:16:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d415e930 con 0x7f18d41554e0 2024-04-25T13:16:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f39c000e420 con 0x7f39c004b090 2024-04-25T13:16:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f0d1cff9640 1 -- 172.21.15.26:0/1771731590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14017070 con 0x7f0d180e0490 2024-04-25T13:16:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda216d8640 1 -- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 msgr2=0x7fda140dce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda216d8640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda140dce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda216d8640 1 -- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda140d7020 msgr2=0x7fda14167250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda216d8640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda140d7020 0x7fda14167250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7ff8b17fa640 1 -- 172.21.15.26:0/1567593674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0037050 con 0x7ff8ac005e80 2024-04-25T13:16:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d180dba90 con 0x7f0d180e0490 2024-04-25T13:16:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7ff8b17fa640 1 -- 172.21.15.26:0/1567593674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a0038040 con 0x7ff8ac005e80 2024-04-25T13:16:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda216d8640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda14052050 con 0x7fda14047a10 2024-04-25T13:16:46.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d415eef0 con 0x7f18d41554e0 2024-04-25T13:16:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.956+0000 7fda226da640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda140d7020 0x7fda14167250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7fda21ed9640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda140dce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7fda216d8640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda14047a10 0x7fda140daa50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0090b0 tx=0x7fda0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac008830 con 0x7ff8ac005e80 2024-04-25T13:16:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ac052c00 con 0x7ff8ac005e80 2024-04-25T13:16:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7ff8b17fa640 1 -- 172.21.15.26:0/1567593674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0037050 con 0x7ff8ac005e80 2024-04-25T13:16:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7fda50ca6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda440d7020 0x7fda44175170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7fda50ca6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda440e0890 0x7fda440df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7fda4b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda440d7020 0x7fda44175170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7fda4b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda440d7020 0x7fda44175170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:58866/0 (socket says 172.21.15.26:58866) 2024-04-25T13:16:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7fda4b7fe640 1 -- 172.21.15.26:0/3549072304 learned_addr learned my addr 172.21.15.26:0/3549072304 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7f39c67fc640 1 -- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c00d5200 msgr2=0x7f39c00dbd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7f39c67fc640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c00d5200 0x7f39c00dbd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7f39c67fc640 1 -- 172.21.15.26:0/1519626899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 msgr2=0x7f39c00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7f39c67fc640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7f39c67fc640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00dc520 con 0x7f39c004b090 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.957+0000 7f39c67fc640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c004b090 0x7f39c0049640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c520 tx=0x7f39bc00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7f39affff640 1 -- 172.21.15.26:0/1519626899 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc017070 con 0x7f39c004b090 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7f39affff640 1 -- 172.21.15.26:0/1519626899 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc007540 con 0x7f39c004b090 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7f39affff640 1 -- 172.21.15.26:0/1519626899 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc004a00 con 0x7f39c004b090 2024-04-25T13:16:46.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440e0cd0 0x7fda440df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7f938d218640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f938004ba50 0x7f938004f560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f938400d830 tx=0x7f938400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7fda4affd640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda440e0890 0x7fda440df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ac00a2e0 con 0x7ff8ac005e80 2024-04-25T13:16:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c00dc800 con 0x7f39c004b090 2024-04-25T13:16:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c00cd780 con 0x7f39c004b090 2024-04-25T13:16:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7fda127fc640 1 -- 172.21.15.26:0/624539623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c041070 con 0x7fda14047a10 2024-04-25T13:16:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7fda4bfff640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440e0cd0 0x7fda440df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.958+0000 7f937dffb640 1 -- 172.21.15.26:0/986525744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938400b6c0 con 0x7f938004ba50 2024-04-25T13:16:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda14052310 con 0x7fda14047a10 2024-04-25T13:16:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fda440e0090 con 0x7fda440e0cd0 2024-04-25T13:16:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda440e0400 con 0x7fda440e0890 2024-04-25T13:16:46.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fda44005e90 con 0x7fda440d7020 2024-04-25T13:16:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7f18d0ff9640 1 -- 172.21.15.26:0/1495611564 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18c401a070 con 0x7f18d41554e0 2024-04-25T13:16:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda14050590 con 0x7fda14047a10 2024-04-25T13:16:46.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d4068e40 con 0x7f18d41554e0 2024-04-25T13:16:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7f18d0ff9640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f18c006c970 0x7f18c006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7f18d0ff9640 1 -- 172.21.15.26:0/1495611564 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f18c408aff0 con 0x7f18d41554e0 2024-04-25T13:16:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d180dc050 con 0x7f0d180e0490 2024-04-25T13:16:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.960+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938004e7e0 con 0x7f938004ba50 2024-04-25T13:16:46.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.960+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938004a050 con 0x7f938004ba50 2024-04-25T13:16:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda4affd640 1 -- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda440d7020 msgr2=0x7fda44175170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda4affd640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda440d7020 0x7fda44175170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda4affd640 1 -- 172.21.15.26:0/3549072304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440e0cd0 msgr2=0x7fda440df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda4affd640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440e0cd0 0x7fda440df6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.960+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda14005380 con 0x7fda14047a10 2024-04-25T13:16:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda4affd640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda440cd320 con 0x7fda440e0890 2024-04-25T13:16:46.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.959+0000 7fda4bfff640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440e0cd0 0x7fda440df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.960+0000 7f39affff640 1 -- 172.21.15.26:0/1519626899 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39bc01a070 con 0x7f39c004b090 2024-04-25T13:16:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.960+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c0005390 con 0x7f39c004b090 2024-04-25T13:16:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.960+0000 7f0d1cff9640 1 -- 172.21.15.26:0/1771731590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140035f0 con 0x7f0d180e0490 2024-04-25T13:16:46.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.961+0000 7fda127fc640 1 -- 172.21.15.26:0/624539623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c046450 con 0x7fda14047a10 2024-04-25T13:16:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.961+0000 7f39affff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f39b4075100 0x7f39b40775c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.961+0000 7f39affff640 1 -- 172.21.15.26:0/1519626899 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39bc08b450 con 0x7f39c004b090 2024-04-25T13:16:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.961+0000 7f0d1cff9640 1 -- 172.21.15.26:0/1771731590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14003a20 con 0x7f0d180e0490 2024-04-25T13:16:46.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.961+0000 7f39c6ffd640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f39b4075100 0x7f39b40775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.961+0000 7fda127fc640 1 -- 172.21.15.26:0/624539623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c04b060 con 0x7fda14047a10 2024-04-25T13:16:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7ff8b17fa640 1 -- 172.21.15.26:0/1567593674 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff8a003c910 con 0x7ff8ac005e80 2024-04-25T13:16:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7f18d3fff640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f18c006c970 0x7f18c006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7f937dffb640 1 -- 172.21.15.26:0/986525744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9384019070 con 0x7f938004ba50 2024-04-25T13:16:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d00005290 con 0x7f0d180e0490 2024-04-25T13:16:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7f0d1cff9640 1 -- 172.21.15.26:0/1771731590 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d1401a070 con 0x7f0d180e0490 2024-04-25T13:16:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7f937dffb640 1 -- 172.21.15.26:0/986525744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938400bc70 con 0x7f938004ba50 2024-04-25T13:16:46.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7ff8b17fa640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff89806caf0 0x7ff89806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7ff8b17fa640 1 -- 172.21.15.26:0/1567593674 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff8a00ad250 con 0x7ff8ac005e80 2024-04-25T13:16:46.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7fda4affd640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda440e0890 0x7fda440df1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fda3800b440 tx=0x7fda3800b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7f0d1cff9640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0d0406c8a0 0x7f0d0406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.962+0000 7ff8b3fff640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff89806caf0 0x7ff89806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.963+0000 7f0d1ffff640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0d0406c8a0 0x7f0d0406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.963+0000 7f39c6ffd640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f39b4075100 0x7f39b40775c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f39b8006fd0 tx=0x7f39b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.963+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9368005290 con 0x7f938004ba50 2024-04-25T13:16:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.963+0000 7ff8b3fff640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff89806caf0 0x7ff89806efb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0d1770 tx=0x7ff8b406b520 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.963+0000 7f0d1cff9640 1 -- 172.21.15.26:0/1771731590 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d14056a60 con 0x7f0d180e0490 2024-04-25T13:16:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.963+0000 7f18d3fff640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f18c006c970 0x7f18c006ee30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc000f80 tx=0x7f18cc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda127fc640 1 -- 172.21.15.26:0/624539623 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda0c044070 con 0x7fda14047a10 2024-04-25T13:16:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7f0d1ffff640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0d0406c8a0 0x7f0d0406ed60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800ff40 tx=0x7f0d200ac000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda127fc640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda0006c8f0 0x7fda0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda37fff640 1 -- 172.21.15.26:0/3549072304 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38015030 con 0x7fda440e0890 2024-04-25T13:16:46.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7f937dffb640 1 -- 172.21.15.26:0/986525744 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9384014430 con 0x7f938004ba50 2024-04-25T13:16:46.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda37fff640 1 -- 172.21.15.26:0/3549072304 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda38004020 con 0x7fda440e0890 2024-04-25T13:16:46.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda37fff640 1 -- 172.21.15.26:0/3549072304 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38004410 con 0x7fda440e0890 2024-04-25T13:16:46.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda21ed9640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda0006c8f0 0x7fda0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda44177e70 con 0x7fda440e0890 2024-04-25T13:16:46.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7f18d0ff9640 1 -- 172.21.15.26:0/1495611564 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f18d41558c0 con 0x7f18d41554e0 2024-04-25T13:16:46.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.964+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda441783d0 con 0x7fda440e0890 2024-04-25T13:16:46.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.965+0000 7f937dffb640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f936c06c8f0 0x7f936c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.965+0000 7f938ca17640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f936c06c8f0 0x7f936c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.965+0000 7fda21ed9640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda0006c8f0 0x7fda0006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda18009a20 tx=0x7fda18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.966+0000 7f938ca17640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f936c06c8f0 0x7f936c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9378034000 tx=0x7f937802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.966+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda44005390 con 0x7fda440e0890 2024-04-25T13:16:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.966+0000 7fda37fff640 1 -- 172.21.15.26:0/3549072304 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda38018070 con 0x7fda440e0890 2024-04-25T13:16:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.967+0000 7fda37fff640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda3006c9c0 0x7fda3006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.967+0000 7fda4b7fe640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda3006c9c0 0x7fda3006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.967+0000 7fda37fff640 1 -- 172.21.15.26:0/3549072304 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda3808b8e0 con 0x7fda440e0890 2024-04-25T13:16:46.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.967+0000 7f39affff640 1 -- 172.21.15.26:0/1519626899 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39bc059420 con 0x7f39c004b090 2024-04-25T13:16:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.967+0000 7fda4b7fe640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda3006c9c0 0x7fda3006ee80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda40009630 tx=0x7fda4002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.970+0000 7f937dffb640 1 -- 172.21.15.26:0/986525744 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9384057f80 con 0x7f938004ba50 2024-04-25T13:16:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.970+0000 7ff8b17fa640 1 -- 172.21.15.26:0/1567593674 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8ac00a2e0 con 0x7ff8ac005e80 2024-04-25T13:16:46.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.970+0000 7fda127fc640 1 -- 172.21.15.26:0/624539623 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda0c078660 con 0x7fda14047a10 2024-04-25T13:16:46.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.971+0000 7fda37fff640 1 -- 172.21.15.26:0/3549072304 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda380599b0 con 0x7fda440e0890 2024-04-25T13:16:46.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.974+0000 7f0d1cff9640 1 -- 172.21.15.26:0/1771731590 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d140589c0 con 0x7f0d180e0490 2024-04-25T13:16:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.979+0000 7fda127fc640 1 -- 172.21.15.26:0/624539623 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda0c07acc0 con 0x7fda14047a10 2024-04-25T13:16:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:45.989+0000 7f937dffb640 1 -- 172.21.15.26:0/986525744 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9384059ee0 con 0x7f938004ba50 2024-04-25T13:16:46.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.342+0000 7fb97064e640 1 -- 172.21.15.26:0/797430262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb950005850 con 0x7fb96806e850 2024-04-25T13:16:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.344+0000 7fb95effd640 1 -- 172.21.15.26:0/797430262 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb960058f80 con 0x7fb96806e850 2024-04-25T13:16:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.347+0000 7fb95cff9640 1 -- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb94c06ca20 msgr2=0x7fb94c06eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.347+0000 7fb95cff9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb94c06ca20 0x7fb94c06eee0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb964037000 tx=0x7fb964032000 comp rx=0 tx=0).stop 2024-04-25T13:16:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.347+0000 7fb95cff9640 1 -- 172.21.15.26:0/797430262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806e850 msgr2=0x7fb9681582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.347+0000 7fb95cff9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806e850 0x7fb9681582b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb960001ce0 tx=0x7fb9600021a0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 -- 172.21.15.26:0/797430262 shutdown_connections 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb94c06ca20 0x7fb94c06eee0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb964037000 tx=0x7fb964032000 comp rx=0 tx=0).stop 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb96806f870 0x7fb9681544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96806ec30 0x7fb968153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 --2- 172.21.15.26:0/797430262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96806e850 0x7fb9681582b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 -- 172.21.15.26:0/797430262 >> 172.21.15.26:0/797430262 conn(0x7fb9680c8f00 msgr2=0x7fb968072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 -- 172.21.15.26:0/797430262 shutdown_connections 2024-04-25T13:16:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.348+0000 7fb95cff9640 1 -- 172.21.15.26:0/797430262 wait complete. 2024-04-25T13:16:46.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2024-04-25T13:16:46.366 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.383+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0d00005850 con 0x7f0d180e0490 2024-04-25T13:16:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.383+0000 7f0d1cff9640 1 -- 172.21.15.26:0/1771731590 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d1405ccc0 con 0x7f0d180e0490 2024-04-25T13:16:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.385+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0d0406c8a0 msgr2=0x7f0d0406ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.385+0000 7f0d25306640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0d0406c8a0 0x7f0d0406ed60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800ff40 tx=0x7f0d200ac000 comp rx=0 tx=0).stop 2024-04-25T13:16:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180e0490 msgr2=0x7f0d18178210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180e0490 0x7f0d18178210 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c410 tx=0x7f0d1400c8d0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 shutdown_connections 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0d0406c8a0 0x7f0d0406ed60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d180e0490 0x7f0d18178210 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d180d9250 0x7f0d180df570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 --2- 172.21.15.26:0/1771731590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d1804ffd0 0x7f0d18175720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 >> 172.21.15.26:0/1771731590 conn(0x7f0d1800e160 msgr2=0x7f0d180d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 shutdown_connections 2024-04-25T13:16:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.386+0000 7f0d25306640 1 -- 172.21.15.26:0/1771731590 wait complete. 2024-04-25T13:16:46.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2024-04-25T13:16:46.398 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.404+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f18d40c74a0 con 0x7f18d41554e0 2024-04-25T13:16:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.405+0000 7f18d0ff9640 1 -- 172.21.15.26:0/1495611564 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18c4058c00 con 0x7f18d41554e0 2024-04-25T13:16:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:60129542156 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f18c006c970 msgr2=0x7f18c006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f18c006c970 0x7f18c006ee30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc000f80 tx=0x7f18cc02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 msgr2=0x7f18d415b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415b140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18d40cc230 tx=0x7f18c400c760 comp rx=0 tx=0).stop 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 shutdown_connections 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f18c006c970 0x7f18c006ee30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18d41554e0 0x7f18d415b140 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18d40b5450 0x7f18d415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.407+0000 7f18da859640 1 --2- 172.21.15.26:0/1495611564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18d40b3c00 0x7f18d4150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.408+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 >> 172.21.15.26:0/1495611564 conn(0x7f18d4074d50 msgr2=0x7f18d4152910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.408+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 shutdown_connections 2024-04-25T13:16:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.408+0000 7f18da859640 1 -- 172.21.15.26:0/1495611564 wait complete. 2024-04-25T13:16:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.408+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f39c0007710 con 0x7f39c004b090 2024-04-25T13:16:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.409+0000 7f39affff640 1 -- 172.21.15.26:0/1519626899 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39bc058d20 con 0x7f39c004b090 2024-04-25T13:16:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f39b4075100 msgr2=0x7f39b40775c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f39b4075100 0x7f39b40775c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f39b8006fd0 tx=0x7f39b8008040 comp rx=0 tx=0).stop 2024-04-25T13:16:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c004b090 msgr2=0x7f39c0049640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c004b090 0x7f39c0049640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c520 tx=0x7f39bc00c9e0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 shutdown_connections 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f39b4075100 0x7f39b40775c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c00d5200 0x7f39c00dbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39c004b090 0x7f39c0049640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 --2- 172.21.15.26:0/1519626899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39c0005e90 0x7f39c00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 >> 172.21.15.26:0/1519626899 conn(0x7f39c0050180 msgr2=0x7f39c0006c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 shutdown_connections 2024-04-25T13:16:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.412+0000 7f39c7fff640 1 -- 172.21.15.26:0/1519626899 wait complete. 2024-04-25T13:16:46.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.415+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fda440d6370 con 0x7fda440e0890 2024-04-25T13:16:46.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.416+0000 7fda37fff640 1 -- 172.21.15.26:0/3549072304 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda380592b0 con 0x7fda440e0890 2024-04-25T13:16:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.418+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff8ac034b00 con 0x7ff8ac005e80 2024-04-25T13:16:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7ff8b17fa640 1 -- 172.21.15.26:0/1567593674 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8a007b3c0 con 0x7ff8ac005e80 2024-04-25T13:16:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda3006c9c0 msgr2=0x7fda3006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda3006c9c0 0x7fda3006ee80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda40009630 tx=0x7fda4002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda440e0890 msgr2=0x7fda440df1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda440e0890 0x7fda440df1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fda3800b440 tx=0x7fda3800b900 comp rx=0 tx=0).stop 2024-04-25T13:16:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 shutdown_connections 2024-04-25T13:16:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda3006c9c0 0x7fda3006ee80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda440e0cd0 0x7fda440df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda440e0890 0x7fda440df1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 --2- 172.21.15.26:0/3549072304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda440d7020 0x7fda44175170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.419+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 >> 172.21.15.26:0/3549072304 conn(0x7fda44050180 msgr2=0x7fda4404e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.420+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 shutdown_connections 2024-04-25T13:16:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.420+0000 7fda50ca6640 1 -- 172.21.15.26:0/3549072304 wait complete. 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff89806caf0 msgr2=0x7ff89806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff89806caf0 0x7ff89806efb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0d1770 tx=0x7ff8b406b520 comp rx=0 tx=0).stop 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ac005e80 msgr2=0x7ff8ac1789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ac005e80 0x7ff8ac1789e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009890 tx=0x7ff8a00046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 shutdown_connections 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff89806caf0 0x7ff89806efb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8ac0de070 0x7ff8ac0508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8ac0d6b20 0x7ff8ac04d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 --2- 172.21.15.26:0/1567593674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ac005e80 0x7ff8ac1789e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 >> 172.21.15.26:0/1567593674 conn(0x7ff8ac04ee20 msgr2=0x7ff8ac0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 shutdown_connections 2024-04-25T13:16:46.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.422+0000 7ff8b9c60640 1 -- 172.21.15.26:0/1567593674 wait complete. 2024-04-25T13:16:46.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.4 2024-04-25T13:16:46.426 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2024-04-25T13:16:46.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.428+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fda1404dd90 con 0x7fda14047a10 2024-04-25T13:16:46.429 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.429+0000 7fda127fc640 1 -- 172.21.15.26:0/624539623 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda0c07a5c0 con 0x7fda14047a10 2024-04-25T13:16:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-25T13:16:46.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.430+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9368005580 con 0x7f938004ba50 2024-04-25T13:16:46.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.430+0000 7f937dffb640 1 -- 172.21.15.26:0/986525744 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f938405e1e0 con 0x7f938004ba50 2024-04-25T13:16:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.431+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda0006c8f0 msgr2=0x7fda0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda0006c8f0 0x7fda0006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda18009a20 tx=0x7fda18008040 comp rx=0 tx=0).stop 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda14047a10 msgr2=0x7fda140daa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda14047a10 0x7fda140daa50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0090b0 tx=0x7fda0c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 shutdown_connections 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fda0006c8f0 0x7fda0006edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda140d7020 0x7fda14167250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda14047a10 0x7fda140daa50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 --2- 172.21.15.26:0/624539623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda14047330 0x7fda140dce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 >> 172.21.15.26:0/624539623 conn(0x7fda14009e40 msgr2=0x7fda14036460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 shutdown_connections 2024-04-25T13:16:46.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7fda22edb640 1 -- 172.21.15.26:0/624539623 wait complete. 2024-04-25T13:16:46.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f936c06c8f0 msgr2=0x7f936c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f936c06c8f0 0x7f936c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9378034000 tx=0x7f937802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:46.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f938004ba50 msgr2=0x7f938004f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f938004ba50 0x7f938004f560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f938400d830 tx=0x7f938400dcf0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 shutdown_connections 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f936c06c8f0 0x7f936c06edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93800e3080 0x7f9380047be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93800dd3b0 0x7f93800d7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 --2- 172.21.15.26:0/986525744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f938004ba50 0x7f938004f560 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.432+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 >> 172.21.15.26:0/986525744 conn(0x7f9380050170 msgr2=0x7f938004a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.433+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 shutdown_connections 2024-04-25T13:16:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.433+0000 7f938e21a640 1 -- 172.21.15.26:0/986525744 wait complete. 2024-04-25T13:16:46.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2024-04-25T13:16:46.436 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-25T13:16:46.437 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2024-04-25T13:16:46.446 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-25T13:16:46.447 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:46.447 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:16:46.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:46.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.587+0000 7f82991c6640 1 Processor -- start 2024-04-25T13:16:46.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.587+0000 7f82991c6640 1 -- start start 2024-04-25T13:16:46.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f82991c6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f82941554e0 0x7f829415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f82991c6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82940d08a0 0x7f82940d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f82991c6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82941558c0 con 0x7f82940b3c00 2024-04-25T13:16:46.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f82991c6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f82940b4a80 con 0x7f82940d08a0 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f82991c6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f829415f630 con 0x7f82941554e0 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f829359e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82940d08a0 0x7f82940d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f829359e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82940d08a0 0x7f82940d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52382/0 (socket says 172.21.15.26:52382) 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f829359e640 1 -- 172.21.15.26:0/1426698868 learned_addr learned my addr 172.21.15.26:0/1426698868 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f8292d9d640 1 --2- 172.21.15.26:0/1426698868 >> v2:172.21.15.169:3300/0 conn(0x7f82941554e0 0x7f829415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f829359e640 1 -- 172.21.15.26:0/1426698868 >> v2:172.21.15.169:3300/0 conn(0x7f82941554e0 msgr2=0x7f829415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f829359e640 1 --2- 172.21.15.26:0/1426698868 >> v2:172.21.15.169:3300/0 conn(0x7f82941554e0 0x7f829415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f829359e640 1 -- 172.21.15.26:0/1426698868 >> v1:172.21.15.169:6789/0 conn(0x7f82940b3c00 legacy=0x7f82940b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f829359e640 1 -- 172.21.15.26:0/1426698868 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82940cb8c0 con 0x7f82940d08a0 2024-04-25T13:16:46.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.588+0000 7f8292d9d640 1 --2- 172.21.15.26:0/1426698868 >> v2:172.21.15.169:3300/0 conn(0x7f82941554e0 0x7f829415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:46.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.589+0000 7f829359e640 1 --2- 172.21.15.26:0/1426698868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82940d08a0 0x7f82940d0cb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f829408e520 tx=0x7f828402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09be1fbb1b6bdba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.589+0000 7f8291d9b640 1 -- 172.21.15.26:0/1426698868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284037070 con 0x7f82940d08a0 2024-04-25T13:16:46.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.589+0000 7f8291d9b640 1 -- 172.21.15.26:0/1426698868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828402ae50 con 0x7f82940d08a0 2024-04-25T13:16:46.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.589+0000 7f8291d9b640 1 -- 172.21.15.26:0/1426698868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284032860 con 0x7f82940d08a0 2024-04-25T13:16:46.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 -- 172.21.15.26:0/1426698868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82940d08a0 msgr2=0x7f82940d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 --2- 172.21.15.26:0/1426698868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82940d08a0 0x7f82940d0cb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f829408e520 tx=0x7f828402a300 comp rx=0 tx=0).stop 2024-04-25T13:16:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 -- 172.21.15.26:0/1426698868 shutdown_connections 2024-04-25T13:16:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 --2- 172.21.15.26:0/1426698868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82940d08a0 0x7f82940d0cb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 --2- 172.21.15.26:0/1426698868 >> v2:172.21.15.169:3300/0 conn(0x7f82941554e0 0x7f829415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 -- 172.21.15.26:0/1426698868 >> 172.21.15.26:0/1426698868 conn(0x7f8294074d50 msgr2=0x7f8294075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 -- 172.21.15.26:0/1426698868 shutdown_connections 2024-04-25T13:16:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.590+0000 7f82991c6640 1 -- 172.21.15.26:0/1426698868 wait complete. 2024-04-25T13:16:46.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.591+0000 7f82991c6640 1 Processor -- start 2024-04-25T13:16:46.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.591+0000 7f82991c6640 1 -- start start 2024-04-25T13:16:46.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f82991c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82940b3c00 0x7f82940ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f82991c6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82940d08a0 0x7f829415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f82991c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82941554e0 0x7f829415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f82991c6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f82940b4430 con 0x7f82941554e0 2024-04-25T13:16:46.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f82991c6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f82940b4150 con 0x7f82940b3c00 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f82991c6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f82940b4710 con 0x7f82940d08a0 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f829359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82941554e0 0x7f829415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f829359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82941554e0 0x7f829415b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52390/0 (socket says 172.21.15.26:52390) 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f8292d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82940b3c00 0x7f82940ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f829359e640 1 -- 172.21.15.26:0/1423759035 learned_addr learned my addr 172.21.15.26:0/1423759035 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f829259c640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82940d08a0 0x7f829415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f8292d9d640 1 -- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82940d08a0 msgr2=0x7f829415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f8292d9d640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82940d08a0 0x7f829415c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f8292d9d640 1 -- 172.21.15.26:0/1423759035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82941554e0 msgr2=0x7f829415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f8292d9d640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82941554e0 0x7f829415b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f8292d9d640 1 -- 172.21.15.26:0/1423759035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8294159a60 con 0x7f82940b3c00 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.592+0000 7f829359e640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82941554e0 0x7f829415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.593+0000 7f8292d9d640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82940b3c00 0x7f82940ca370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f828c00efc0 tx=0x7f828c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.593+0000 7f828b7fe640 1 -- 172.21.15.26:0/1423759035 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c018020 con 0x7f82940b3c00 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.593+0000 7f828b7fe640 1 -- 172.21.15.26:0/1423759035 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c014480 con 0x7f82940b3c00 2024-04-25T13:16:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.593+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82940ca990 con 0x7f82940b3c00 2024-04-25T13:16:46.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.593+0000 7f828b7fe640 1 -- 172.21.15.26:0/1423759035 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c014870 con 0x7f82940b3c00 2024-04-25T13:16:46.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.593+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829415e640 con 0x7f82940b3c00 2024-04-25T13:16:46.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.594+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8294068e40 con 0x7f82940b3c00 2024-04-25T13:16:46.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.594+0000 7f828b7fe640 1 -- 172.21.15.26:0/1423759035 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f828c005d10 con 0x7f82940b3c00 2024-04-25T13:16:46.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.595+0000 7f828b7fe640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f827406c8f0 0x7f827406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.595+0000 7f828b7fe640 1 -- 172.21.15.26:0/1423759035 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f828c08cb30 con 0x7f82940b3c00 2024-04-25T13:16:46.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.595+0000 7f829259c640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f827406c8f0 0x7f827406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.595+0000 7f829259c640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f827406c8f0 0x7f827406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82941eea40 tx=0x7f827c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.599+0000 7f828b7fe640 1 -- 172.21.15.26:0/1423759035 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f828c022030 con 0x7f82940b3c00 2024-04-25T13:16:46.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.784+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82940cc260 con 0x7f827406c8f0 2024-04-25T13:16:46.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.793+0000 7f828b7fe640 1 -- 172.21.15.26:0/1423759035 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f82940cc260 con 0x7f827406c8f0 2024-04-25T13:16:46.797 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:46.798 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f827406c8f0 msgr2=0x7f827406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f827406c8f0 0x7f827406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82941eea40 tx=0x7f827c009040 comp rx=0 tx=0).stop 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82940b3c00 msgr2=0x7f82940ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82940b3c00 0x7f82940ca370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f828c00efc0 tx=0x7f828c00c490 comp rx=0 tx=0).stop 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 shutdown_connections 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f827406c8f0 0x7f827406edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82941554e0 0x7f829415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82940d08a0 0x7f829415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 --2- 172.21.15.26:0/1423759035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82940b3c00 0x7f82940ca370 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 >> 172.21.15.26:0/1423759035 conn(0x7f8294074d50 msgr2=0x7f82940c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 shutdown_connections 2024-04-25T13:16:46.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.796+0000 7f82991c6640 1 -- 172.21.15.26:0/1423759035 wait complete. 2024-04-25T13:16:46.808 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T13:16:45.171845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1989824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002919"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353534+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:16:16.353534+0000","last_peered":"2024-04-25T13:16:16.353534+0000","last_clean":"2024-04-25T13:16:16.353534+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:16:16.353534+0000","last_undegraded":"2024-04-25T13:16:16.353534+0000","last_fullsized":"2024-04-25T13:16:16.353534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:27.622324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246107+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:16.246107+0000","last_peered":"2024-04-25T13:16:16.246107+0000","last_clean":"2024-04-25T13:16:16.246107+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:16.246107+0000","last_undegraded":"2024-04-25T13:16:16.246107+0000","last_fullsized":"2024-04-25T13:16:16.246107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245536+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:16.245536+0000","last_peered":"2024-04-25T13:16:16.245536+0000","last_clean":"2024-04-25T13:16:16.245536+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:16.245536+0000","last_undegraded":"2024-04-25T13:16:16.245536+0000","last_fullsized":"2024-04-25T13:16:16.245536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246261+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:16.246261+0000","last_peered":"2024-04-25T13:16:16.246261+0000","last_clean":"2024-04-25T13:16:16.246261+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:16.246261+0000","last_undegraded":"2024-04-25T13:16:16.246261+0000","last_fullsized":"2024-04-25T13:16:16.246261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353395+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:16.353395+0000","last_peered":"2024-04-25T13:16:16.353395+0000","last_clean":"2024-04-25T13:16:16.353395+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:16.353395+0000","last_undegraded":"2024-04-25T13:16:16.353395+0000","last_fullsized":"2024-04-25T13:16:16.353395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:07.806920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241491+0000","last_change":"2024-04-25T13:16:14.257938+0000","last_active":"2024-04-25T13:16:15.241491+0000","last_peered":"2024-04-25T13:16:15.241491+0000","last_clean":"2024-04-25T13:16:15.241491+0000","last_became_active":"2024-04-25T13:16:14.257583+0000","last_became_peered":"2024-04-25T13:16:14.257583+0000","last_unstale":"2024-04-25T13:16:15.241491+0000","last_undegraded":"2024-04-25T13:16:15.241491+0000","last_fullsized":"2024-04-25T13:16:15.241491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:00.046474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239900+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:16:15.239900+0000","last_peered":"2024-04-25T13:16:15.239900+0000","last_clean":"2024-04-25T13:16:15.239900+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:16:15.239900+0000","last_undegraded":"2024-04-25T13:16:15.239900+0000","last_fullsized":"2024-04-25T13:16:15.239900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353492+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:16.353492+0000","last_peered":"2024-04-25T13:16:16.353492+0000","last_clean":"2024-04-25T13:16:16.353492+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:16.353492+0000","last_undegraded":"2024-04-25T13:16:16.353492+0000","last_fullsized":"2024-04-25T13:16:16.353492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242398+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:15.242398+0000","last_peered":"2024-04-25T13:16:15.242398+0000","last_clean":"2024-04-25T13:16:15.242398+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:15.242398+0000","last_undegraded":"2024-04-25T13:16:15.242398+0000","last_fullsized":"2024-04-25T13:16:15.242398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239287+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:16:15.239287+0000","last_peered":"2024-04-25T13:16:15.239287+0000","last_clean":"2024-04-25T13:16:15.239287+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:16:15.239287+0000","last_undegraded":"2024-04-25T13:16:15.239287+0000","last_fullsized":"2024-04-25T13:16:15.239287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353813+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:16.353813+0000","last_peered":"2024-04-25T13:16:16.353813+0000","last_clean":"2024-04-25T13:16:16.353813+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:16.353813+0000","last_undegraded":"2024-04-25T13:16:16.353813+0000","last_fullsized":"2024-04-25T13:16:16.353813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241607+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:15.241607+0000","last_peered":"2024-04-25T13:16:15.241607+0000","last_clean":"2024-04-25T13:16:15.241607+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:15.241607+0000","last_undegraded":"2024-04-25T13:16:15.241607+0000","last_fullsized":"2024-04-25T13:16:15.241607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353968+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:16.353968+0000","last_peered":"2024-04-25T13:16:16.353968+0000","last_clean":"2024-04-25T13:16:16.353968+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:16.353968+0000","last_undegraded":"2024-04-25T13:16:16.353968+0000","last_fullsized":"2024-04-25T13:16:16.353968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239547+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:15.239547+0000","last_peered":"2024-04-25T13:16:15.239547+0000","last_clean":"2024-04-25T13:16:15.239547+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:15.239547+0000","last_undegraded":"2024-04-25T13:16:15.239547+0000","last_fullsized":"2024-04-25T13:16:15.239547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242365+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:15.242365+0000","last_peered":"2024-04-25T13:16:15.242365+0000","last_clean":"2024-04-25T13:16:15.242365+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:15.242365+0000","last_undegraded":"2024-04-25T13:16:15.242365+0000","last_fullsized":"2024-04-25T13:16:15.242365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245954+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:16.245954+0000","last_peered":"2024-04-25T13:16:16.245954+0000","last_clean":"2024-04-25T13:16:16.245954+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:16.245954+0000","last_undegraded":"2024-04-25T13:16:16.245954+0000","last_fullsized":"2024-04-25T13:16:16.245954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353731+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:16.353731+0000","last_peered":"2024-04-25T13:16:16.353731+0000","last_clean":"2024-04-25T13:16:16.353731+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:16.353731+0000","last_undegraded":"2024-04-25T13:16:16.353731+0000","last_fullsized":"2024-04-25T13:16:16.353731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241972+0000","last_change":"2024-04-25T13:16:14.261022+0000","last_active":"2024-04-25T13:16:15.241972+0000","last_peered":"2024-04-25T13:16:15.241972+0000","last_clean":"2024-04-25T13:16:15.241972+0000","last_became_active":"2024-04-25T13:16:14.260540+0000","last_became_peered":"2024-04-25T13:16:14.260540+0000","last_unstale":"2024-04-25T13:16:15.241972+0000","last_undegraded":"2024-04-25T13:16:15.241972+0000","last_fullsized":"2024-04-25T13:16:15.241972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:17.727873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245714+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:16.245714+0000","last_peered":"2024-04-25T13:16:16.245714+0000","last_clean":"2024-04-25T13:16:16.245714+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:16.245714+0000","last_undegraded":"2024-04-25T13:16:16.245714+0000","last_fullsized":"2024-04-25T13:16:16.245714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353398+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:16:16.353398+0000","last_peered":"2024-04-25T13:16:16.353398+0000","last_clean":"2024-04-25T13:16:16.353398+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:16:16.353398+0000","last_undegraded":"2024-04-25T13:16:16.353398+0000","last_fullsized":"2024-04-25T13:16:16.353398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354184+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:16.354184+0000","last_peered":"2024-04-25T13:16:16.354184+0000","last_clean":"2024-04-25T13:16:16.354184+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:16.354184+0000","last_undegraded":"2024-04-25T13:16:16.354184+0000","last_fullsized":"2024-04-25T13:16:16.354184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241824+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:15.241824+0000","last_peered":"2024-04-25T13:16:15.241824+0000","last_clean":"2024-04-25T13:16:15.241824+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:15.241824+0000","last_undegraded":"2024-04-25T13:16:15.241824+0000","last_fullsized":"2024-04-25T13:16:15.241824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238962+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:15.238962+0000","last_peered":"2024-04-25T13:16:15.238962+0000","last_clean":"2024-04-25T13:16:15.238962+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:15.238962+0000","last_undegraded":"2024-04-25T13:16:15.238962+0000","last_fullsized":"2024-04-25T13:16:15.238962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242094+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:15.242094+0000","last_peered":"2024-04-25T13:16:15.242094+0000","last_clean":"2024-04-25T13:16:15.242094+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:15.242094+0000","last_undegraded":"2024-04-25T13:16:15.242094+0000","last_fullsized":"2024-04-25T13:16:15.242094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354392+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:16.354392+0000","last_peered":"2024-04-25T13:16:16.354392+0000","last_clean":"2024-04-25T13:16:16.354392+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:16.354392+0000","last_undegraded":"2024-04-25T13:16:16.354392+0000","last_fullsized":"2024-04-25T13:16:16.354392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:07.387828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354625+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:16:16.354625+0000","last_peered":"2024-04-25T13:16:16.354625+0000","last_clean":"2024-04-25T13:16:16.354625+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:16:16.354625+0000","last_undegraded":"2024-04-25T13:16:16.354625+0000","last_fullsized":"2024-04-25T13:16:16.354625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241492+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:15.241492+0000","last_peered":"2024-04-25T13:16:15.241492+0000","last_clean":"2024-04-25T13:16:15.241492+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:15.241492+0000","last_undegraded":"2024-04-25T13:16:15.241492+0000","last_fullsized":"2024-04-25T13:16:15.241492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246222+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:16.246222+0000","last_peered":"2024-04-25T13:16:16.246222+0000","last_clean":"2024-04-25T13:16:16.246222+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:16.246222+0000","last_undegraded":"2024-04-25T13:16:16.246222+0000","last_fullsized":"2024-04-25T13:16:16.246222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353936+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:16.353936+0000","last_peered":"2024-04-25T13:16:16.353936+0000","last_clean":"2024-04-25T13:16:16.353936+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:16.353936+0000","last_undegraded":"2024-04-25T13:16:16.353936+0000","last_fullsized":"2024-04-25T13:16:16.353936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245445+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:16.245445+0000","last_peered":"2024-04-25T13:16:16.245445+0000","last_clean":"2024-04-25T13:16:16.245445+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:16.245445+0000","last_undegraded":"2024-04-25T13:16:16.245445+0000","last_fullsized":"2024-04-25T13:16:16.245445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354537+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:16.354537+0000","last_peered":"2024-04-25T13:16:16.354537+0000","last_clean":"2024-04-25T13:16:16.354537+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:16.354537+0000","last_undegraded":"2024-04-25T13:16:16.354537+0000","last_fullsized":"2024-04-25T13:16:16.354537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239990+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:15.239990+0000","last_peered":"2024-04-25T13:16:15.239990+0000","last_clean":"2024-04-25T13:16:15.239990+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:15.239990+0000","last_undegraded":"2024-04-25T13:16:15.239990+0000","last_fullsized":"2024-04-25T13:16:15.239990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:52.881166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354421+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:16.354421+0000","last_peered":"2024-04-25T13:16:16.354421+0000","last_clean":"2024-04-25T13:16:16.354421+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354421+0000","last_undegraded":"2024-04-25T13:16:16.354421+0000","last_fullsized":"2024-04-25T13:16:16.354421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354591+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:16.354591+0000","last_peered":"2024-04-25T13:16:16.354591+0000","last_clean":"2024-04-25T13:16:16.354591+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:16.354591+0000","last_undegraded":"2024-04-25T13:16:16.354591+0000","last_fullsized":"2024-04-25T13:16:16.354591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353448+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:16.353448+0000","last_peered":"2024-04-25T13:16:16.353448+0000","last_clean":"2024-04-25T13:16:16.353448+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:16.353448+0000","last_undegraded":"2024-04-25T13:16:16.353448+0000","last_fullsized":"2024-04-25T13:16:16.353448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242591+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:15.242591+0000","last_peered":"2024-04-25T13:16:15.242591+0000","last_clean":"2024-04-25T13:16:15.242591+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:15.242591+0000","last_undegraded":"2024-04-25T13:16:15.242591+0000","last_fullsized":"2024-04-25T13:16:15.242591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354376+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:16:16.354376+0000","last_peered":"2024-04-25T13:16:16.354376+0000","last_clean":"2024-04-25T13:16:16.354376+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:16:16.354376+0000","last_undegraded":"2024-04-25T13:16:16.354376+0000","last_fullsized":"2024-04-25T13:16:16.354376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354448+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:16.354448+0000","last_peered":"2024-04-25T13:16:16.354448+0000","last_clean":"2024-04-25T13:16:16.354448+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:16.354448+0000","last_undegraded":"2024-04-25T13:16:16.354448+0000","last_fullsized":"2024-04-25T13:16:16.354448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354505+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:16.354505+0000","last_peered":"2024-04-25T13:16:16.354505+0000","last_clean":"2024-04-25T13:16:16.354505+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:16.354505+0000","last_undegraded":"2024-04-25T13:16:16.354505+0000","last_fullsized":"2024-04-25T13:16:16.354505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238775+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:16:15.238775+0000","last_peered":"2024-04-25T13:16:15.238775+0000","last_clean":"2024-04-25T13:16:15.238775+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:16:15.238775+0000","last_undegraded":"2024-04-25T13:16:15.238775+0000","last_fullsized":"2024-04-25T13:16:15.238775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354340+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:16.354340+0000","last_peered":"2024-04-25T13:16:16.354340+0000","last_clean":"2024-04-25T13:16:16.354340+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:16.354340+0000","last_undegraded":"2024-04-25T13:16:16.354340+0000","last_fullsized":"2024-04-25T13:16:16.354340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.352967+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:16.352967+0000","last_peered":"2024-04-25T13:16:16.352967+0000","last_clean":"2024-04-25T13:16:16.352967+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:16.352967+0000","last_undegraded":"2024-04-25T13:16:16.352967+0000","last_fullsized":"2024-04-25T13:16:16.352967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:14.197407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239182+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:15.239182+0000","last_peered":"2024-04-25T13:16:15.239182+0000","last_clean":"2024-04-25T13:16:15.239182+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:15.239182+0000","last_undegraded":"2024-04-25T13:16:15.239182+0000","last_fullsized":"2024-04-25T13:16:15.239182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354197+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:16.354197+0000","last_peered":"2024-04-25T13:16:16.354197+0000","last_clean":"2024-04-25T13:16:16.354197+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:16.354197+0000","last_undegraded":"2024-04-25T13:16:16.354197+0000","last_fullsized":"2024-04-25T13:16:16.354197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:00.494861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245825+0000","last_change":"2024-04-25T13:16:10.234248+0000","last_active":"2024-04-25T13:16:16.245825+0000","last_peered":"2024-04-25T13:16:16.245825+0000","last_clean":"2024-04-25T13:16:16.245825+0000","last_became_active":"2024-04-25T13:16:10.233963+0000","last_became_peered":"2024-04-25T13:16:10.233963+0000","last_unstale":"2024-04-25T13:16:16.245825+0000","last_undegraded":"2024-04-25T13:16:16.245825+0000","last_fullsized":"2024-04-25T13:16:16.245825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:04.216005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353488+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:16.353488+0000","last_peered":"2024-04-25T13:16:16.353488+0000","last_clean":"2024-04-25T13:16:16.353488+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:16.353488+0000","last_undegraded":"2024-04-25T13:16:16.353488+0000","last_fullsized":"2024-04-25T13:16:16.353488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239179+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:15.239179+0000","last_peered":"2024-04-25T13:16:15.239179+0000","last_clean":"2024-04-25T13:16:15.239179+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:15.239179+0000","last_undegraded":"2024-04-25T13:16:15.239179+0000","last_fullsized":"2024-04-25T13:16:15.239179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354218+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:16.354218+0000","last_peered":"2024-04-25T13:16:16.354218+0000","last_clean":"2024-04-25T13:16:16.354218+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:16.354218+0000","last_undegraded":"2024-04-25T13:16:16.354218+0000","last_fullsized":"2024-04-25T13:16:16.354218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239814+0000","last_change":"2024-04-25T13:16:10.234837+0000","last_active":"2024-04-25T13:16:15.239814+0000","last_peered":"2024-04-25T13:16:15.239814+0000","last_clean":"2024-04-25T13:16:15.239814+0000","last_became_active":"2024-04-25T13:16:10.234555+0000","last_became_peered":"2024-04-25T13:16:10.234555+0000","last_unstale":"2024-04-25T13:16:15.239814+0000","last_undegraded":"2024-04-25T13:16:15.239814+0000","last_fullsized":"2024-04-25T13:16:15.239814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:51.058397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238900+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:16:15.238900+0000","last_peered":"2024-04-25T13:16:15.238900+0000","last_clean":"2024-04-25T13:16:15.238900+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:16:15.238900+0000","last_undegraded":"2024-04-25T13:16:15.238900+0000","last_fullsized":"2024-04-25T13:16:15.238900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353858+0000","last_change":"2024-04-25T13:16:14.252829+0000","last_active":"2024-04-25T13:16:16.353858+0000","last_peered":"2024-04-25T13:16:16.353858+0000","last_clean":"2024-04-25T13:16:16.353858+0000","last_became_active":"2024-04-25T13:16:14.252177+0000","last_became_peered":"2024-04-25T13:16:14.252177+0000","last_unstale":"2024-04-25T13:16:16.353858+0000","last_undegraded":"2024-04-25T13:16:16.353858+0000","last_fullsized":"2024-04-25T13:16:16.353858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:36.730765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353599+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:16.353599+0000","last_peered":"2024-04-25T13:16:16.353599+0000","last_clean":"2024-04-25T13:16:16.353599+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:16.353599+0000","last_undegraded":"2024-04-25T13:16:16.353599+0000","last_fullsized":"2024-04-25T13:16:16.353599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354155+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:16.354155+0000","last_peered":"2024-04-25T13:16:16.354155+0000","last_clean":"2024-04-25T13:16:16.354155+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:16.354155+0000","last_undegraded":"2024-04-25T13:16:16.354155+0000","last_fullsized":"2024-04-25T13:16:16.354155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353335+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:16.353335+0000","last_peered":"2024-04-25T13:16:16.353335+0000","last_clean":"2024-04-25T13:16:16.353335+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:16.353335+0000","last_undegraded":"2024-04-25T13:16:16.353335+0000","last_fullsized":"2024-04-25T13:16:16.353335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:35.815826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239702+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:15.239702+0000","last_peered":"2024-04-25T13:16:15.239702+0000","last_clean":"2024-04-25T13:16:15.239702+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:15.239702+0000","last_undegraded":"2024-04-25T13:16:15.239702+0000","last_fullsized":"2024-04-25T13:16:15.239702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238960+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:16:15.238960+0000","last_peered":"2024-04-25T13:16:15.238960+0000","last_clean":"2024-04-25T13:16:15.238960+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:16:15.238960+0000","last_undegraded":"2024-04-25T13:16:15.238960+0000","last_fullsized":"2024-04-25T13:16:15.238960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353010+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:16.353010+0000","last_peered":"2024-04-25T13:16:16.353010+0000","last_clean":"2024-04-25T13:16:16.353010+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:16.353010+0000","last_undegraded":"2024-04-25T13:16:16.353010+0000","last_fullsized":"2024-04-25T13:16:16.353010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239534+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:15.239534+0000","last_peered":"2024-04-25T13:16:15.239534+0000","last_clean":"2024-04-25T13:16:15.239534+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:15.239534+0000","last_undegraded":"2024-04-25T13:16:15.239534+0000","last_fullsized":"2024-04-25T13:16:15.239534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242078+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:15.242078+0000","last_peered":"2024-04-25T13:16:15.242078+0000","last_clean":"2024-04-25T13:16:15.242078+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:15.242078+0000","last_undegraded":"2024-04-25T13:16:15.242078+0000","last_fullsized":"2024-04-25T13:16:15.242078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241484+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:15.241484+0000","last_peered":"2024-04-25T13:16:15.241484+0000","last_clean":"2024-04-25T13:16:15.241484+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:15.241484+0000","last_undegraded":"2024-04-25T13:16:15.241484+0000","last_fullsized":"2024-04-25T13:16:15.241484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239108+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:15.239108+0000","last_peered":"2024-04-25T13:16:15.239108+0000","last_clean":"2024-04-25T13:16:15.239108+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:15.239108+0000","last_undegraded":"2024-04-25T13:16:15.239108+0000","last_fullsized":"2024-04-25T13:16:15.239108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238426+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:15.238426+0000","last_peered":"2024-04-25T13:16:15.238426+0000","last_clean":"2024-04-25T13:16:15.238426+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:15.238426+0000","last_undegraded":"2024-04-25T13:16:15.238426+0000","last_fullsized":"2024-04-25T13:16:15.238426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354056+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:16.354056+0000","last_peered":"2024-04-25T13:16:16.354056+0000","last_clean":"2024-04-25T13:16:16.354056+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:16.354056+0000","last_undegraded":"2024-04-25T13:16:16.354056+0000","last_fullsized":"2024-04-25T13:16:16.354056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:15.310573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353676+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:16.353676+0000","last_peered":"2024-04-25T13:16:16.353676+0000","last_clean":"2024-04-25T13:16:16.353676+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:16.353676+0000","last_undegraded":"2024-04-25T13:16:16.353676+0000","last_fullsized":"2024-04-25T13:16:16.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354116+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:16:16.354116+0000","last_peered":"2024-04-25T13:16:16.354116+0000","last_clean":"2024-04-25T13:16:16.354116+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:16:16.354116+0000","last_undegraded":"2024-04-25T13:16:16.354116+0000","last_fullsized":"2024-04-25T13:16:16.354116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246099+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:16.246099+0000","last_peered":"2024-04-25T13:16:16.246099+0000","last_clean":"2024-04-25T13:16:16.246099+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:16.246099+0000","last_undegraded":"2024-04-25T13:16:16.246099+0000","last_fullsized":"2024-04-25T13:16:16.246099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239499+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:15.239499+0000","last_peered":"2024-04-25T13:16:15.239499+0000","last_clean":"2024-04-25T13:16:15.239499+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:15.239499+0000","last_undegraded":"2024-04-25T13:16:15.239499+0000","last_fullsized":"2024-04-25T13:16:15.239499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353468+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:16.353468+0000","last_peered":"2024-04-25T13:16:16.353468+0000","last_clean":"2024-04-25T13:16:16.353468+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:16.353468+0000","last_undegraded":"2024-04-25T13:16:16.353468+0000","last_fullsized":"2024-04-25T13:16:16.353468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246276+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:16.246276+0000","last_peered":"2024-04-25T13:16:16.246276+0000","last_clean":"2024-04-25T13:16:16.246276+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:16.246276+0000","last_undegraded":"2024-04-25T13:16:16.246276+0000","last_fullsized":"2024-04-25T13:16:16.246276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353735+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:16.353735+0000","last_peered":"2024-04-25T13:16:16.353735+0000","last_clean":"2024-04-25T13:16:16.353735+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:16.353735+0000","last_undegraded":"2024-04-25T13:16:16.353735+0000","last_fullsized":"2024-04-25T13:16:16.353735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:24.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353518+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:16:16.353518+0000","last_peered":"2024-04-25T13:16:16.353518+0000","last_clean":"2024-04-25T13:16:16.353518+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:16:16.353518+0000","last_undegraded":"2024-04-25T13:16:16.353518+0000","last_fullsized":"2024-04-25T13:16:16.353518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:49.859293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353792+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:16.353792+0000","last_peered":"2024-04-25T13:16:16.353792+0000","last_clean":"2024-04-25T13:16:16.353792+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:16.353792+0000","last_undegraded":"2024-04-25T13:16:16.353792+0000","last_fullsized":"2024-04-25T13:16:16.353792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239616+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:15.239616+0000","last_peered":"2024-04-25T13:16:15.239616+0000","last_clean":"2024-04-25T13:16:15.239616+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:15.239616+0000","last_undegraded":"2024-04-25T13:16:15.239616+0000","last_fullsized":"2024-04-25T13:16:15.239616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:30.515181+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:16:30.515181+0000","last_peered":"2024-04-25T13:16:30.515181+0000","last_clean":"2024-04-25T13:16:30.515181+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:16:30.515181+0000","last_undegraded":"2024-04-25T13:16:30.515181+0000","last_fullsized":"2024-04-25T13:16:30.515181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353615+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:16.353615+0000","last_peered":"2024-04-25T13:16:16.353615+0000","last_clean":"2024-04-25T13:16:16.353615+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:16.353615+0000","last_undegraded":"2024-04-25T13:16:16.353615+0000","last_fullsized":"2024-04-25T13:16:16.353615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242098+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:15.242098+0000","last_peered":"2024-04-25T13:16:15.242098+0000","last_clean":"2024-04-25T13:16:15.242098+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:15.242098+0000","last_undegraded":"2024-04-25T13:16:15.242098+0000","last_fullsized":"2024-04-25T13:16:15.242098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354055+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:16.354055+0000","last_peered":"2024-04-25T13:16:16.354055+0000","last_clean":"2024-04-25T13:16:16.354055+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:16.354055+0000","last_undegraded":"2024-04-25T13:16:16.354055+0000","last_fullsized":"2024-04-25T13:16:16.354055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242563+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:15.242563+0000","last_peered":"2024-04-25T13:16:15.242563+0000","last_clean":"2024-04-25T13:16:15.242563+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:15.242563+0000","last_undegraded":"2024-04-25T13:16:15.242563+0000","last_fullsized":"2024-04-25T13:16:15.242563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353633+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:16.353633+0000","last_peered":"2024-04-25T13:16:16.353633+0000","last_clean":"2024-04-25T13:16:16.353633+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:16.353633+0000","last_undegraded":"2024-04-25T13:16:16.353633+0000","last_fullsized":"2024-04-25T13:16:16.353633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:59.519018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353823+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:16:16.353823+0000","last_peered":"2024-04-25T13:16:16.353823+0000","last_clean":"2024-04-25T13:16:16.353823+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:16:16.353823+0000","last_undegraded":"2024-04-25T13:16:16.353823+0000","last_fullsized":"2024-04-25T13:16:16.353823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245632+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:16.245632+0000","last_peered":"2024-04-25T13:16:16.245632+0000","last_clean":"2024-04-25T13:16:16.245632+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:16.245632+0000","last_undegraded":"2024-04-25T13:16:16.245632+0000","last_fullsized":"2024-04-25T13:16:16.245632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353701+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:16.353701+0000","last_peered":"2024-04-25T13:16:16.353701+0000","last_clean":"2024-04-25T13:16:16.353701+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:16.353701+0000","last_undegraded":"2024-04-25T13:16:16.353701+0000","last_fullsized":"2024-04-25T13:16:16.353701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354545+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:16:16.354545+0000","last_peered":"2024-04-25T13:16:16.354545+0000","last_clean":"2024-04-25T13:16:16.354545+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:16:16.354545+0000","last_undegraded":"2024-04-25T13:16:16.354545+0000","last_fullsized":"2024-04-25T13:16:16.354545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245573+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:16.245573+0000","last_peered":"2024-04-25T13:16:16.245573+0000","last_clean":"2024-04-25T13:16:16.245573+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:16.245573+0000","last_undegraded":"2024-04-25T13:16:16.245573+0000","last_fullsized":"2024-04-25T13:16:16.245573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353911+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:16.353911+0000","last_peered":"2024-04-25T13:16:16.353911+0000","last_clean":"2024-04-25T13:16:16.353911+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:16.353911+0000","last_undegraded":"2024-04-25T13:16:16.353911+0000","last_fullsized":"2024-04-25T13:16:16.353911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.475502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353851+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:16.353851+0000","last_peered":"2024-04-25T13:16:16.353851+0000","last_clean":"2024-04-25T13:16:16.353851+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:16.353851+0000","last_undegraded":"2024-04-25T13:16:16.353851+0000","last_fullsized":"2024-04-25T13:16:16.353851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353153+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:16.353153+0000","last_peered":"2024-04-25T13:16:16.353153+0000","last_clean":"2024-04-25T13:16:16.353153+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:16.353153+0000","last_undegraded":"2024-04-25T13:16:16.353153+0000","last_fullsized":"2024-04-25T13:16:16.353153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354404+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:16.354404+0000","last_peered":"2024-04-25T13:16:16.354404+0000","last_clean":"2024-04-25T13:16:16.354404+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:16.354404+0000","last_undegraded":"2024-04-25T13:16:16.354404+0000","last_fullsized":"2024-04-25T13:16:16.354404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245598+0000","last_change":"2024-04-25T13:16:10.230726+0000","last_active":"2024-04-25T13:16:16.245598+0000","last_peered":"2024-04-25T13:16:16.245598+0000","last_clean":"2024-04-25T13:16:16.245598+0000","last_became_active":"2024-04-25T13:16:10.228712+0000","last_became_peered":"2024-04-25T13:16:10.228712+0000","last_unstale":"2024-04-25T13:16:16.245598+0000","last_undegraded":"2024-04-25T13:16:16.245598+0000","last_fullsized":"2024-04-25T13:16:16.245598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:43.499305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245839+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:16.245839+0000","last_peered":"2024-04-25T13:16:16.245839+0000","last_clean":"2024-04-25T13:16:16.245839+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:16.245839+0000","last_undegraded":"2024-04-25T13:16:16.245839+0000","last_fullsized":"2024-04-25T13:16:16.245839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354063+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:16.354063+0000","last_peered":"2024-04-25T13:16:16.354063+0000","last_clean":"2024-04-25T13:16:16.354063+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:16.354063+0000","last_undegraded":"2024-04-25T13:16:16.354063+0000","last_fullsized":"2024-04-25T13:16:16.354063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353420+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:16.353420+0000","last_peered":"2024-04-25T13:16:16.353420+0000","last_clean":"2024-04-25T13:16:16.353420+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:16.353420+0000","last_undegraded":"2024-04-25T13:16:16.353420+0000","last_fullsized":"2024-04-25T13:16:16.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238725+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:15.238725+0000","last_peered":"2024-04-25T13:16:15.238725+0000","last_clean":"2024-04-25T13:16:15.238725+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:15.238725+0000","last_undegraded":"2024-04-25T13:16:15.238725+0000","last_fullsized":"2024-04-25T13:16:15.238725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246106+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:16:16.246106+0000","last_peered":"2024-04-25T13:16:16.246106+0000","last_clean":"2024-04-25T13:16:16.246106+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:16:16.246106+0000","last_undegraded":"2024-04-25T13:16:16.246106+0000","last_fullsized":"2024-04-25T13:16:16.246106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241834+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:15.241834+0000","last_peered":"2024-04-25T13:16:15.241834+0000","last_clean":"2024-04-25T13:16:15.241834+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:15.241834+0000","last_undegraded":"2024-04-25T13:16:15.241834+0000","last_fullsized":"2024-04-25T13:16:15.241834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246117+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:16.246117+0000","last_peered":"2024-04-25T13:16:16.246117+0000","last_clean":"2024-04-25T13:16:16.246117+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:16.246117+0000","last_undegraded":"2024-04-25T13:16:16.246117+0000","last_fullsized":"2024-04-25T13:16:16.246117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353553+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:16.353553+0000","last_peered":"2024-04-25T13:16:16.353553+0000","last_clean":"2024-04-25T13:16:16.353553+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:16.353553+0000","last_undegraded":"2024-04-25T13:16:16.353553+0000","last_fullsized":"2024-04-25T13:16:16.353553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238557+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:15.238557+0000","last_peered":"2024-04-25T13:16:15.238557+0000","last_clean":"2024-04-25T13:16:15.238557+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:15.238557+0000","last_undegraded":"2024-04-25T13:16:15.238557+0000","last_fullsized":"2024-04-25T13:16:15.238557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353362+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:16.353362+0000","last_peered":"2024-04-25T13:16:16.353362+0000","last_clean":"2024-04-25T13:16:16.353362+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:16.353362+0000","last_undegraded":"2024-04-25T13:16:16.353362+0000","last_fullsized":"2024-04-25T13:16:16.353362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353399+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:16.353399+0000","last_peered":"2024-04-25T13:16:16.353399+0000","last_clean":"2024-04-25T13:16:16.353399+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:16.353399+0000","last_undegraded":"2024-04-25T13:16:16.353399+0000","last_fullsized":"2024-04-25T13:16:16.353399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:23.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246373+0000","last_change":"2024-04-25T13:16:10.236483+0000","last_active":"2024-04-25T13:16:16.246373+0000","last_peered":"2024-04-25T13:16:16.246373+0000","last_clean":"2024-04-25T13:16:16.246373+0000","last_became_active":"2024-04-25T13:16:10.236179+0000","last_became_peered":"2024-04-25T13:16:10.236179+0000","last_unstale":"2024-04-25T13:16:16.246373+0000","last_undegraded":"2024-04-25T13:16:16.246373+0000","last_fullsized":"2024-04-25T13:16:16.246373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:23.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354239+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:16.354239+0000","last_peered":"2024-04-25T13:16:16.354239+0000","last_clean":"2024-04-25T13:16:16.354239+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:16.354239+0000","last_undegraded":"2024-04-25T13:16:16.354239+0000","last_fullsized":"2024-04-25T13:16:16.354239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354433+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:16.354433+0000","last_peered":"2024-04-25T13:16:16.354433+0000","last_clean":"2024-04-25T13:16:16.354433+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:16.354433+0000","last_undegraded":"2024-04-25T13:16:16.354433+0000","last_fullsized":"2024-04-25T13:16:16.354433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246083+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:16.246083+0000","last_peered":"2024-04-25T13:16:16.246083+0000","last_clean":"2024-04-25T13:16:16.246083+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:16.246083+0000","last_undegraded":"2024-04-25T13:16:16.246083+0000","last_fullsized":"2024-04-25T13:16:16.246083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353298+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:16.353298+0000","last_peered":"2024-04-25T13:16:16.353298+0000","last_clean":"2024-04-25T13:16:16.353298+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:16.353298+0000","last_undegraded":"2024-04-25T13:16:16.353298+0000","last_fullsized":"2024-04-25T13:16:16.353298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245689+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:16.245689+0000","last_peered":"2024-04-25T13:16:16.245689+0000","last_clean":"2024-04-25T13:16:16.245689+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:16.245689+0000","last_undegraded":"2024-04-25T13:16:16.245689+0000","last_fullsized":"2024-04-25T13:16:16.245689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353453+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:16.353453+0000","last_peered":"2024-04-25T13:16:16.353453+0000","last_clean":"2024-04-25T13:16:16.353453+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:16.353453+0000","last_undegraded":"2024-04-25T13:16:16.353453+0000","last_fullsized":"2024-04-25T13:16:16.353453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353184+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:16.353184+0000","last_peered":"2024-04-25T13:16:16.353184+0000","last_clean":"2024-04-25T13:16:16.353184+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:16.353184+0000","last_undegraded":"2024-04-25T13:16:16.353184+0000","last_fullsized":"2024-04-25T13:16:16.353184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:52.980650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354190+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:16.354190+0000","last_peered":"2024-04-25T13:16:16.354190+0000","last_clean":"2024-04-25T13:16:16.354190+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:16.354190+0000","last_undegraded":"2024-04-25T13:16:16.354190+0000","last_fullsized":"2024-04-25T13:16:16.354190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239903+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:15.239903+0000","last_peered":"2024-04-25T13:16:15.239903+0000","last_clean":"2024-04-25T13:16:15.239903+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:15.239903+0000","last_undegraded":"2024-04-25T13:16:15.239903+0000","last_fullsized":"2024-04-25T13:16:15.239903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238907+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:15.238907+0000","last_peered":"2024-04-25T13:16:15.238907+0000","last_clean":"2024-04-25T13:16:15.238907+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:15.238907+0000","last_undegraded":"2024-04-25T13:16:15.238907+0000","last_fullsized":"2024-04-25T13:16:15.238907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354124+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:16.354124+0000","last_peered":"2024-04-25T13:16:16.354124+0000","last_clean":"2024-04-25T13:16:16.354124+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:16.354124+0000","last_undegraded":"2024-04-25T13:16:16.354124+0000","last_fullsized":"2024-04-25T13:16:16.354124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353029+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:16.353029+0000","last_peered":"2024-04-25T13:16:16.353029+0000","last_clean":"2024-04-25T13:16:16.353029+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:16.353029+0000","last_undegraded":"2024-04-25T13:16:16.353029+0000","last_fullsized":"2024-04-25T13:16:16.353029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353364+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:16.353364+0000","last_peered":"2024-04-25T13:16:16.353364+0000","last_clean":"2024-04-25T13:16:16.353364+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:16.353364+0000","last_undegraded":"2024-04-25T13:16:16.353364+0000","last_fullsized":"2024-04-25T13:16:16.353364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:44.821443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245843+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:16.245843+0000","last_peered":"2024-04-25T13:16:16.245843+0000","last_clean":"2024-04-25T13:16:16.245843+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:16.245843+0000","last_undegraded":"2024-04-25T13:16:16.245843+0000","last_fullsized":"2024-04-25T13:16:16.245843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241900+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:15.241900+0000","last_peered":"2024-04-25T13:16:15.241900+0000","last_clean":"2024-04-25T13:16:15.241900+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:15.241900+0000","last_undegraded":"2024-04-25T13:16:15.241900+0000","last_fullsized":"2024-04-25T13:16:15.241900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354206+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:16.354206+0000","last_peered":"2024-04-25T13:16:16.354206+0000","last_clean":"2024-04-25T13:16:16.354206+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354206+0000","last_undegraded":"2024-04-25T13:16:16.354206+0000","last_fullsized":"2024-04-25T13:16:16.354206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354360+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:16.354360+0000","last_peered":"2024-04-25T13:16:16.354360+0000","last_clean":"2024-04-25T13:16:16.354360+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:16.354360+0000","last_undegraded":"2024-04-25T13:16:16.354360+0000","last_fullsized":"2024-04-25T13:16:16.354360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239639+0000","last_change":"2024-04-25T13:16:10.239397+0000","last_active":"2024-04-25T13:16:15.239639+0000","last_peered":"2024-04-25T13:16:15.239639+0000","last_clean":"2024-04-25T13:16:15.239639+0000","last_became_active":"2024-04-25T13:16:10.239142+0000","last_became_peered":"2024-04-25T13:16:10.239142+0000","last_unstale":"2024-04-25T13:16:15.239639+0000","last_undegraded":"2024-04-25T13:16:15.239639+0000","last_fullsized":"2024-04-25T13:16:15.239639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:10.151896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245495+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:16.245495+0000","last_peered":"2024-04-25T13:16:16.245495+0000","last_clean":"2024-04-25T13:16:16.245495+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:16.245495+0000","last_undegraded":"2024-04-25T13:16:16.245495+0000","last_fullsized":"2024-04-25T13:16:16.245495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239010+0000","last_change":"2024-04-25T13:16:10.224097+0000","last_active":"2024-04-25T13:16:15.239010+0000","last_peered":"2024-04-25T13:16:15.239010+0000","last_clean":"2024-04-25T13:16:15.239010+0000","last_became_active":"2024-04-25T13:16:10.222594+0000","last_became_peered":"2024-04-25T13:16:10.222594+0000","last_unstale":"2024-04-25T13:16:15.239010+0000","last_undegraded":"2024-04-25T13:16:15.239010+0000","last_fullsized":"2024-04-25T13:16:15.239010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:21.148411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353185+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:16.353185+0000","last_peered":"2024-04-25T13:16:16.353185+0000","last_clean":"2024-04-25T13:16:16.353185+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:16.353185+0000","last_undegraded":"2024-04-25T13:16:16.353185+0000","last_fullsized":"2024-04-25T13:16:16.353185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239336+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:15.239336+0000","last_peered":"2024-04-25T13:16:15.239336+0000","last_clean":"2024-04-25T13:16:15.239336+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:15.239336+0000","last_undegraded":"2024-04-25T13:16:15.239336+0000","last_fullsized":"2024-04-25T13:16:15.239336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353309+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:16.353309+0000","last_peered":"2024-04-25T13:16:16.353309+0000","last_clean":"2024-04-25T13:16:16.353309+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:16.353309+0000","last_undegraded":"2024-04-25T13:16:16.353309+0000","last_fullsized":"2024-04-25T13:16:16.353309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353609+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:16.353609+0000","last_peered":"2024-04-25T13:16:16.353609+0000","last_clean":"2024-04-25T13:16:16.353609+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:16.353609+0000","last_undegraded":"2024-04-25T13:16:16.353609+0000","last_fullsized":"2024-04-25T13:16:16.353609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:51.820664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353877+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:16.353877+0000","last_peered":"2024-04-25T13:16:16.353877+0000","last_clean":"2024-04-25T13:16:16.353877+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:16.353877+0000","last_undegraded":"2024-04-25T13:16:16.353877+0000","last_fullsized":"2024-04-25T13:16:16.353877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239431+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:15.239431+0000","last_peered":"2024-04-25T13:16:15.239431+0000","last_clean":"2024-04-25T13:16:15.239431+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:15.239431+0000","last_undegraded":"2024-04-25T13:16:15.239431+0000","last_fullsized":"2024-04-25T13:16:15.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":99976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":690982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:46.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.949+0000 7fa12dccb640 1 Processor -- start 2024-04-25T13:16:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.949+0000 7fa12dccb640 1 -- start start 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa12dccb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281554e0 0x7fa12815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa12dccb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1280b3c00 0x7fa1280b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa12dccb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa1280b5450 0x7fa1280d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa12dccb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa1280b4a80 con 0x7fa1280b3c00 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa12dccb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa1281558c0 con 0x7fa1280b5450 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa12dccb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa12815f630 con 0x7fa1281554e0 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1280b3c00 0x7fa1280b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1280b3c00 0x7fa1280b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52404/0 (socket says 172.21.15.26:52404) 2024-04-25T13:16:46.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 -- 172.21.15.26:0/2057747649 learned_addr learned my addr 172.21.15.26:0/2057747649 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa1277fe640 1 --2- 172.21.15.26:0/2057747649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281554e0 0x7fa12815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa127fff640 1 --2- 172.21.15.26:0/2057747649 >> v2:172.21.15.169:3300/0 conn(0x7fa1280b5450 0x7fa1280d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 -- 172.21.15.26:0/2057747649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281554e0 msgr2=0x7fa12815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 --2- 172.21.15.26:0/2057747649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281554e0 0x7fa12815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 -- 172.21.15.26:0/2057747649 >> v2:172.21.15.169:3300/0 conn(0x7fa1280b5450 msgr2=0x7fa1280d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 --2- 172.21.15.26:0/2057747649 >> v2:172.21.15.169:3300/0 conn(0x7fa1280b5450 0x7fa1280d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.950+0000 7fa126ffd640 1 -- 172.21.15.26:0/2057747649 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1280cb8c0 con 0x7fa1280b3c00 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.951+0000 7fa126ffd640 1 --2- 172.21.15.26:0/2057747649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1280b3c00 0x7fa1280b4f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1280caf10 tx=0x7fa11c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822f88d974c6eace server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.951+0000 7fa1267fc640 1 -- 172.21.15.26:0/2057747649 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c037070 con 0x7fa1280b3c00 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.951+0000 7fa1267fc640 1 -- 172.21.15.26:0/2057747649 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c032440 con 0x7fa1280b3c00 2024-04-25T13:16:46.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.951+0000 7fa1267fc640 1 -- 172.21.15.26:0/2057747649 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c032810 con 0x7fa1280b3c00 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 -- 172.21.15.26:0/2057747649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1280b3c00 msgr2=0x7fa1280b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2057747649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1280b3c00 0x7fa1280b4f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1280caf10 tx=0x7fa11c02a270 comp rx=0 tx=0).stop 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 -- 172.21.15.26:0/2057747649 shutdown_connections 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2057747649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1280b3c00 0x7fa1280b4f10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2057747649 >> v2:172.21.15.169:3300/0 conn(0x7fa1280b5450 0x7fa1280d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2057747649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281554e0 0x7fa12815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 -- 172.21.15.26:0/2057747649 >> 172.21.15.26:0/2057747649 conn(0x7fa128074d50 msgr2=0x7fa128075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 -- 172.21.15.26:0/2057747649 shutdown_connections 2024-04-25T13:16:46.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.952+0000 7fa12dccb640 1 -- 172.21.15.26:0/2057747649 wait complete. 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.953+0000 7fa12dccb640 1 Processor -- start 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.953+0000 7fa12dccb640 1 -- start start 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa12dccb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280b3c00 0x7fa1281f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa12dccb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1280b5450 0x7fa12815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa12dccb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1281554e0 0x7fa1280ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa12dccb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa1280b4430 con 0x7fa1281554e0 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa12dccb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1280b4150 con 0x7fa1280b5450 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa12dccb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa1280b4710 con 0x7fa1280b3c00 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1281554e0 0x7fa1280ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1281554e0 0x7fa1280ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52412/0 (socket says 172.21.15.26:52412) 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 -- 172.21.15.26:0/2982159962 learned_addr learned my addr 172.21.15.26:0/2982159962 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa126ffd640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1280b5450 0x7fa12815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa1277fe640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280b3c00 0x7fa1281f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 -- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280b3c00 msgr2=0x7fa1281f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280b3c00 0x7fa1281f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 -- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1280b5450 msgr2=0x7fa12815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1280b5450 0x7fa12815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.954+0000 7fa127fff640 1 -- 172.21.15.26:0/2982159962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1281f5050 con 0x7fa1281554e0 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.955+0000 7fa127fff640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1281554e0 0x7fa1280ca110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa12000eed0 tx=0x7fa12000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.955+0000 7fa10ffff640 1 -- 172.21.15.26:0/2982159962 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120018020 con 0x7fa1281554e0 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.955+0000 7fa10ffff640 1 -- 172.21.15.26:0/2982159962 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120014400 con 0x7fa1281554e0 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.955+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1280c9710 con 0x7fa1281554e0 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.955+0000 7fa10ffff640 1 -- 172.21.15.26:0/2982159962 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1200147f0 con 0x7fa1281554e0 2024-04-25T13:16:46.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.955+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1280c9cd0 con 0x7fa1281554e0 2024-04-25T13:16:46.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.956+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1280d0660 con 0x7fa1281554e0 2024-04-25T13:16:46.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.956+0000 7fa10ffff640 1 -- 172.21.15.26:0/2982159962 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa120005d10 con 0x7fa1281554e0 2024-04-25T13:16:46.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.957+0000 7fa10ffff640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa11406c8f0 0x7fa11406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.957+0000 7fa10ffff640 1 -- 172.21.15.26:0/2982159962 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa12008c740 con 0x7fa1281554e0 2024-04-25T13:16:46.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.957+0000 7fa1277fe640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa11406c8f0 0x7fa11406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.957+0000 7fa1277fe640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa11406c8f0 0x7fa11406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa118009b40 tx=0x7fa118009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:46.961+0000 7fa10ffff640 1 -- 172.21.15.26:0/2982159962 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1280d0660 con 0x7fa1281554e0 2024-04-25T13:16:47.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.142+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa128068e40 con 0x7fa11406c8f0 2024-04-25T13:16:47.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.149+0000 7fa10ffff640 1 -- 172.21.15.26:0/2982159962 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fa128068e40 con 0x7fa11406c8f0 2024-04-25T13:16:47.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:16:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa11406c8f0 msgr2=0x7fa11406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa11406c8f0 0x7fa11406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa118009b40 tx=0x7fa118009190 comp rx=0 tx=0).stop 2024-04-25T13:16:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1281554e0 msgr2=0x7fa1280ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1281554e0 0x7fa1280ca110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa12000eed0 tx=0x7fa12000b480 comp rx=0 tx=0).stop 2024-04-25T13:16:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 shutdown_connections 2024-04-25T13:16:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa11406c8f0 0x7fa11406edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1281554e0 0x7fa1280ca110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1280b5450 0x7fa12815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 --2- 172.21.15.26:0/2982159962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280b3c00 0x7fa1281f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 >> 172.21.15.26:0/2982159962 conn(0x7fa128074d50 msgr2=0x7fa1280cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 shutdown_connections 2024-04-25T13:16:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.153+0000 7fa12dccb640 1 -- 172.21.15.26:0/2982159962 wait complete. 2024-04-25T13:16:47.165 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T13:16:45.171845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1989824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002919"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353534+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:16:16.353534+0000","last_peered":"2024-04-25T13:16:16.353534+0000","last_clean":"2024-04-25T13:16:16.353534+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:16:16.353534+0000","last_undegraded":"2024-04-25T13:16:16.353534+0000","last_fullsized":"2024-04-25T13:16:16.353534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:27.622324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246107+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:16.246107+0000","last_peered":"2024-04-25T13:16:16.246107+0000","last_clean":"2024-04-25T13:16:16.246107+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:16.246107+0000","last_undegraded":"2024-04-25T13:16:16.246107+0000","last_fullsized":"2024-04-25T13:16:16.246107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245536+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:16.245536+0000","last_peered":"2024-04-25T13:16:16.245536+0000","last_clean":"2024-04-25T13:16:16.245536+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:16.245536+0000","last_undegraded":"2024-04-25T13:16:16.245536+0000","last_fullsized":"2024-04-25T13:16:16.245536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246261+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:16.246261+0000","last_peered":"2024-04-25T13:16:16.246261+0000","last_clean":"2024-04-25T13:16:16.246261+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:16.246261+0000","last_undegraded":"2024-04-25T13:16:16.246261+0000","last_fullsized":"2024-04-25T13:16:16.246261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353395+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:16.353395+0000","last_peered":"2024-04-25T13:16:16.353395+0000","last_clean":"2024-04-25T13:16:16.353395+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:16.353395+0000","last_undegraded":"2024-04-25T13:16:16.353395+0000","last_fullsized":"2024-04-25T13:16:16.353395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:07.806920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241491+0000","last_change":"2024-04-25T13:16:14.257938+0000","last_active":"2024-04-25T13:16:15.241491+0000","last_peered":"2024-04-25T13:16:15.241491+0000","last_clean":"2024-04-25T13:16:15.241491+0000","last_became_active":"2024-04-25T13:16:14.257583+0000","last_became_peered":"2024-04-25T13:16:14.257583+0000","last_unstale":"2024-04-25T13:16:15.241491+0000","last_undegraded":"2024-04-25T13:16:15.241491+0000","last_fullsized":"2024-04-25T13:16:15.241491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:00.046474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239900+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:16:15.239900+0000","last_peered":"2024-04-25T13:16:15.239900+0000","last_clean":"2024-04-25T13:16:15.239900+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:16:15.239900+0000","last_undegraded":"2024-04-25T13:16:15.239900+0000","last_fullsized":"2024-04-25T13:16:15.239900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353492+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:16.353492+0000","last_peered":"2024-04-25T13:16:16.353492+0000","last_clean":"2024-04-25T13:16:16.353492+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:16.353492+0000","last_undegraded":"2024-04-25T13:16:16.353492+0000","last_fullsized":"2024-04-25T13:16:16.353492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242398+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:15.242398+0000","last_peered":"2024-04-25T13:16:15.242398+0000","last_clean":"2024-04-25T13:16:15.242398+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:15.242398+0000","last_undegraded":"2024-04-25T13:16:15.242398+0000","last_fullsized":"2024-04-25T13:16:15.242398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239287+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:16:15.239287+0000","last_peered":"2024-04-25T13:16:15.239287+0000","last_clean":"2024-04-25T13:16:15.239287+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:16:15.239287+0000","last_undegraded":"2024-04-25T13:16:15.239287+0000","last_fullsized":"2024-04-25T13:16:15.239287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353813+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:16.353813+0000","last_peered":"2024-04-25T13:16:16.353813+0000","last_clean":"2024-04-25T13:16:16.353813+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:16.353813+0000","last_undegraded":"2024-04-25T13:16:16.353813+0000","last_fullsized":"2024-04-25T13:16:16.353813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241607+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:15.241607+0000","last_peered":"2024-04-25T13:16:15.241607+0000","last_clean":"2024-04-25T13:16:15.241607+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:15.241607+0000","last_undegraded":"2024-04-25T13:16:15.241607+0000","last_fullsized":"2024-04-25T13:16:15.241607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353968+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:16.353968+0000","last_peered":"2024-04-25T13:16:16.353968+0000","last_clean":"2024-04-25T13:16:16.353968+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:16.353968+0000","last_undegraded":"2024-04-25T13:16:16.353968+0000","last_fullsized":"2024-04-25T13:16:16.353968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239547+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:15.239547+0000","last_peered":"2024-04-25T13:16:15.239547+0000","last_clean":"2024-04-25T13:16:15.239547+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:15.239547+0000","last_undegraded":"2024-04-25T13:16:15.239547+0000","last_fullsized":"2024-04-25T13:16:15.239547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242365+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:15.242365+0000","last_peered":"2024-04-25T13:16:15.242365+0000","last_clean":"2024-04-25T13:16:15.242365+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:15.242365+0000","last_undegraded":"2024-04-25T13:16:15.242365+0000","last_fullsized":"2024-04-25T13:16:15.242365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245954+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:16.245954+0000","last_peered":"2024-04-25T13:16:16.245954+0000","last_clean":"2024-04-25T13:16:16.245954+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:16.245954+0000","last_undegraded":"2024-04-25T13:16:16.245954+0000","last_fullsized":"2024-04-25T13:16:16.245954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353731+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:16.353731+0000","last_peered":"2024-04-25T13:16:16.353731+0000","last_clean":"2024-04-25T13:16:16.353731+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:16.353731+0000","last_undegraded":"2024-04-25T13:16:16.353731+0000","last_fullsized":"2024-04-25T13:16:16.353731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241972+0000","last_change":"2024-04-25T13:16:14.261022+0000","last_active":"2024-04-25T13:16:15.241972+0000","last_peered":"2024-04-25T13:16:15.241972+0000","last_clean":"2024-04-25T13:16:15.241972+0000","last_became_active":"2024-04-25T13:16:14.260540+0000","last_became_peered":"2024-04-25T13:16:14.260540+0000","last_unstale":"2024-04-25T13:16:15.241972+0000","last_undegraded":"2024-04-25T13:16:15.241972+0000","last_fullsized":"2024-04-25T13:16:15.241972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:17.727873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245714+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:16.245714+0000","last_peered":"2024-04-25T13:16:16.245714+0000","last_clean":"2024-04-25T13:16:16.245714+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:16.245714+0000","last_undegraded":"2024-04-25T13:16:16.245714+0000","last_fullsized":"2024-04-25T13:16:16.245714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353398+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:16:16.353398+0000","last_peered":"2024-04-25T13:16:16.353398+0000","last_clean":"2024-04-25T13:16:16.353398+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:16:16.353398+0000","last_undegraded":"2024-04-25T13:16:16.353398+0000","last_fullsized":"2024-04-25T13:16:16.353398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354184+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:16.354184+0000","last_peered":"2024-04-25T13:16:16.354184+0000","last_clean":"2024-04-25T13:16:16.354184+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:16.354184+0000","last_undegraded":"2024-04-25T13:16:16.354184+0000","last_fullsized":"2024-04-25T13:16:16.354184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241824+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:15.241824+0000","last_peered":"2024-04-25T13:16:15.241824+0000","last_clean":"2024-04-25T13:16:15.241824+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:15.241824+0000","last_undegraded":"2024-04-25T13:16:15.241824+0000","last_fullsized":"2024-04-25T13:16:15.241824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238962+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:15.238962+0000","last_peered":"2024-04-25T13:16:15.238962+0000","last_clean":"2024-04-25T13:16:15.238962+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:15.238962+0000","last_undegraded":"2024-04-25T13:16:15.238962+0000","last_fullsized":"2024-04-25T13:16:15.238962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242094+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:15.242094+0000","last_peered":"2024-04-25T13:16:15.242094+0000","last_clean":"2024-04-25T13:16:15.242094+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:15.242094+0000","last_undegraded":"2024-04-25T13:16:15.242094+0000","last_fullsized":"2024-04-25T13:16:15.242094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354392+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:16.354392+0000","last_peered":"2024-04-25T13:16:16.354392+0000","last_clean":"2024-04-25T13:16:16.354392+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:16.354392+0000","last_undegraded":"2024-04-25T13:16:16.354392+0000","last_fullsized":"2024-04-25T13:16:16.354392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:07.387828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354625+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:16:16.354625+0000","last_peered":"2024-04-25T13:16:16.354625+0000","last_clean":"2024-04-25T13:16:16.354625+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:16:16.354625+0000","last_undegraded":"2024-04-25T13:16:16.354625+0000","last_fullsized":"2024-04-25T13:16:16.354625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241492+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:15.241492+0000","last_peered":"2024-04-25T13:16:15.241492+0000","last_clean":"2024-04-25T13:16:15.241492+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:15.241492+0000","last_undegraded":"2024-04-25T13:16:15.241492+0000","last_fullsized":"2024-04-25T13:16:15.241492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246222+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:16.246222+0000","last_peered":"2024-04-25T13:16:16.246222+0000","last_clean":"2024-04-25T13:16:16.246222+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:16.246222+0000","last_undegraded":"2024-04-25T13:16:16.246222+0000","last_fullsized":"2024-04-25T13:16:16.246222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353936+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:16.353936+0000","last_peered":"2024-04-25T13:16:16.353936+0000","last_clean":"2024-04-25T13:16:16.353936+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:16.353936+0000","last_undegraded":"2024-04-25T13:16:16.353936+0000","last_fullsized":"2024-04-25T13:16:16.353936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245445+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:16.245445+0000","last_peered":"2024-04-25T13:16:16.245445+0000","last_clean":"2024-04-25T13:16:16.245445+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:16.245445+0000","last_undegraded":"2024-04-25T13:16:16.245445+0000","last_fullsized":"2024-04-25T13:16:16.245445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354537+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:16.354537+0000","last_peered":"2024-04-25T13:16:16.354537+0000","last_clean":"2024-04-25T13:16:16.354537+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:16.354537+0000","last_undegraded":"2024-04-25T13:16:16.354537+0000","last_fullsized":"2024-04-25T13:16:16.354537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239990+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:15.239990+0000","last_peered":"2024-04-25T13:16:15.239990+0000","last_clean":"2024-04-25T13:16:15.239990+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:15.239990+0000","last_undegraded":"2024-04-25T13:16:15.239990+0000","last_fullsized":"2024-04-25T13:16:15.239990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:52.881166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354421+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:16.354421+0000","last_peered":"2024-04-25T13:16:16.354421+0000","last_clean":"2024-04-25T13:16:16.354421+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354421+0000","last_undegraded":"2024-04-25T13:16:16.354421+0000","last_fullsized":"2024-04-25T13:16:16.354421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354591+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:16.354591+0000","last_peered":"2024-04-25T13:16:16.354591+0000","last_clean":"2024-04-25T13:16:16.354591+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:16.354591+0000","last_undegraded":"2024-04-25T13:16:16.354591+0000","last_fullsized":"2024-04-25T13:16:16.354591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353448+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:16.353448+0000","last_peered":"2024-04-25T13:16:16.353448+0000","last_clean":"2024-04-25T13:16:16.353448+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:16.353448+0000","last_undegraded":"2024-04-25T13:16:16.353448+0000","last_fullsized":"2024-04-25T13:16:16.353448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242591+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:15.242591+0000","last_peered":"2024-04-25T13:16:15.242591+0000","last_clean":"2024-04-25T13:16:15.242591+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:15.242591+0000","last_undegraded":"2024-04-25T13:16:15.242591+0000","last_fullsized":"2024-04-25T13:16:15.242591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354376+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:16:16.354376+0000","last_peered":"2024-04-25T13:16:16.354376+0000","last_clean":"2024-04-25T13:16:16.354376+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:16:16.354376+0000","last_undegraded":"2024-04-25T13:16:16.354376+0000","last_fullsized":"2024-04-25T13:16:16.354376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354448+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:16.354448+0000","last_peered":"2024-04-25T13:16:16.354448+0000","last_clean":"2024-04-25T13:16:16.354448+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:16.354448+0000","last_undegraded":"2024-04-25T13:16:16.354448+0000","last_fullsized":"2024-04-25T13:16:16.354448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354505+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:16.354505+0000","last_peered":"2024-04-25T13:16:16.354505+0000","last_clean":"2024-04-25T13:16:16.354505+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:16.354505+0000","last_undegraded":"2024-04-25T13:16:16.354505+0000","last_fullsized":"2024-04-25T13:16:16.354505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238775+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:16:15.238775+0000","last_peered":"2024-04-25T13:16:15.238775+0000","last_clean":"2024-04-25T13:16:15.238775+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:16:15.238775+0000","last_undegraded":"2024-04-25T13:16:15.238775+0000","last_fullsized":"2024-04-25T13:16:15.238775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354340+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:16.354340+0000","last_peered":"2024-04-25T13:16:16.354340+0000","last_clean":"2024-04-25T13:16:16.354340+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:16.354340+0000","last_undegraded":"2024-04-25T13:16:16.354340+0000","last_fullsized":"2024-04-25T13:16:16.354340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.352967+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:16.352967+0000","last_peered":"2024-04-25T13:16:16.352967+0000","last_clean":"2024-04-25T13:16:16.352967+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:16.352967+0000","last_undegraded":"2024-04-25T13:16:16.352967+0000","last_fullsized":"2024-04-25T13:16:16.352967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:14.197407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239182+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:15.239182+0000","last_peered":"2024-04-25T13:16:15.239182+0000","last_clean":"2024-04-25T13:16:15.239182+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:15.239182+0000","last_undegraded":"2024-04-25T13:16:15.239182+0000","last_fullsized":"2024-04-25T13:16:15.239182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354197+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:16.354197+0000","last_peered":"2024-04-25T13:16:16.354197+0000","last_clean":"2024-04-25T13:16:16.354197+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:16.354197+0000","last_undegraded":"2024-04-25T13:16:16.354197+0000","last_fullsized":"2024-04-25T13:16:16.354197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:00.494861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245825+0000","last_change":"2024-04-25T13:16:10.234248+0000","last_active":"2024-04-25T13:16:16.245825+0000","last_peered":"2024-04-25T13:16:16.245825+0000","last_clean":"2024-04-25T13:16:16.245825+0000","last_became_active":"2024-04-25T13:16:10.233963+0000","last_became_peered":"2024-04-25T13:16:10.233963+0000","last_unstale":"2024-04-25T13:16:16.245825+0000","last_undegraded":"2024-04-25T13:16:16.245825+0000","last_fullsized":"2024-04-25T13:16:16.245825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:04.216005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353488+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:16.353488+0000","last_peered":"2024-04-25T13:16:16.353488+0000","last_clean":"2024-04-25T13:16:16.353488+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:16.353488+0000","last_undegraded":"2024-04-25T13:16:16.353488+0000","last_fullsized":"2024-04-25T13:16:16.353488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239179+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:15.239179+0000","last_peered":"2024-04-25T13:16:15.239179+0000","last_clean":"2024-04-25T13:16:15.239179+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:15.239179+0000","last_undegraded":"2024-04-25T13:16:15.239179+0000","last_fullsized":"2024-04-25T13:16:15.239179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354218+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:16.354218+0000","last_peered":"2024-04-25T13:16:16.354218+0000","last_clean":"2024-04-25T13:16:16.354218+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:16.354218+0000","last_undegraded":"2024-04-25T13:16:16.354218+0000","last_fullsized":"2024-04-25T13:16:16.354218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239814+0000","last_change":"2024-04-25T13:16:10.234837+0000","last_active":"2024-04-25T13:16:15.239814+0000","last_peered":"2024-04-25T13:16:15.239814+0000","last_clean":"2024-04-25T13:16:15.239814+0000","last_became_active":"2024-04-25T13:16:10.234555+0000","last_became_peered":"2024-04-25T13:16:10.234555+0000","last_unstale":"2024-04-25T13:16:15.239814+0000","last_undegraded":"2024-04-25T13:16:15.239814+0000","last_fullsized":"2024-04-25T13:16:15.239814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:51.058397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238900+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:16:15.238900+0000","last_peered":"2024-04-25T13:16:15.238900+0000","last_clean":"2024-04-25T13:16:15.238900+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:16:15.238900+0000","last_undegraded":"2024-04-25T13:16:15.238900+0000","last_fullsized":"2024-04-25T13:16:15.238900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353858+0000","last_change":"2024-04-25T13:16:14.252829+0000","last_active":"2024-04-25T13:16:16.353858+0000","last_peered":"2024-04-25T13:16:16.353858+0000","last_clean":"2024-04-25T13:16:16.353858+0000","last_became_active":"2024-04-25T13:16:14.252177+0000","last_became_peered":"2024-04-25T13:16:14.252177+0000","last_unstale":"2024-04-25T13:16:16.353858+0000","last_undegraded":"2024-04-25T13:16:16.353858+0000","last_fullsized":"2024-04-25T13:16:16.353858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:36.730765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353599+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:16.353599+0000","last_peered":"2024-04-25T13:16:16.353599+0000","last_clean":"2024-04-25T13:16:16.353599+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:16.353599+0000","last_undegraded":"2024-04-25T13:16:16.353599+0000","last_fullsized":"2024-04-25T13:16:16.353599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354155+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:16.354155+0000","last_peered":"2024-04-25T13:16:16.354155+0000","last_clean":"2024-04-25T13:16:16.354155+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:16.354155+0000","last_undegraded":"2024-04-25T13:16:16.354155+0000","last_fullsized":"2024-04-25T13:16:16.354155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353335+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:16.353335+0000","last_peered":"2024-04-25T13:16:16.353335+0000","last_clean":"2024-04-25T13:16:16.353335+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:16.353335+0000","last_undegraded":"2024-04-25T13:16:16.353335+0000","last_fullsized":"2024-04-25T13:16:16.353335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:35.815826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239702+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:15.239702+0000","last_peered":"2024-04-25T13:16:15.239702+0000","last_clean":"2024-04-25T13:16:15.239702+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:15.239702+0000","last_undegraded":"2024-04-25T13:16:15.239702+0000","last_fullsized":"2024-04-25T13:16:15.239702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238960+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:16:15.238960+0000","last_peered":"2024-04-25T13:16:15.238960+0000","last_clean":"2024-04-25T13:16:15.238960+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:16:15.238960+0000","last_undegraded":"2024-04-25T13:16:15.238960+0000","last_fullsized":"2024-04-25T13:16:15.238960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353010+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:16.353010+0000","last_peered":"2024-04-25T13:16:16.353010+0000","last_clean":"2024-04-25T13:16:16.353010+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:16.353010+0000","last_undegraded":"2024-04-25T13:16:16.353010+0000","last_fullsized":"2024-04-25T13:16:16.353010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239534+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:15.239534+0000","last_peered":"2024-04-25T13:16:15.239534+0000","last_clean":"2024-04-25T13:16:15.239534+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:15.239534+0000","last_undegraded":"2024-04-25T13:16:15.239534+0000","last_fullsized":"2024-04-25T13:16:15.239534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242078+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:15.242078+0000","last_peered":"2024-04-25T13:16:15.242078+0000","last_clean":"2024-04-25T13:16:15.242078+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:15.242078+0000","last_undegraded":"2024-04-25T13:16:15.242078+0000","last_fullsized":"2024-04-25T13:16:15.242078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241484+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:15.241484+0000","last_peered":"2024-04-25T13:16:15.241484+0000","last_clean":"2024-04-25T13:16:15.241484+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:15.241484+0000","last_undegraded":"2024-04-25T13:16:15.241484+0000","last_fullsized":"2024-04-25T13:16:15.241484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239108+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:15.239108+0000","last_peered":"2024-04-25T13:16:15.239108+0000","last_clean":"2024-04-25T13:16:15.239108+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:15.239108+0000","last_undegraded":"2024-04-25T13:16:15.239108+0000","last_fullsized":"2024-04-25T13:16:15.239108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238426+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:15.238426+0000","last_peered":"2024-04-25T13:16:15.238426+0000","last_clean":"2024-04-25T13:16:15.238426+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:15.238426+0000","last_undegraded":"2024-04-25T13:16:15.238426+0000","last_fullsized":"2024-04-25T13:16:15.238426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354056+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:16.354056+0000","last_peered":"2024-04-25T13:16:16.354056+0000","last_clean":"2024-04-25T13:16:16.354056+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:16.354056+0000","last_undegraded":"2024-04-25T13:16:16.354056+0000","last_fullsized":"2024-04-25T13:16:16.354056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:15.310573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353676+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:16.353676+0000","last_peered":"2024-04-25T13:16:16.353676+0000","last_clean":"2024-04-25T13:16:16.353676+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:16.353676+0000","last_undegraded":"2024-04-25T13:16:16.353676+0000","last_fullsized":"2024-04-25T13:16:16.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354116+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:16:16.354116+0000","last_peered":"2024-04-25T13:16:16.354116+0000","last_clean":"2024-04-25T13:16:16.354116+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:16:16.354116+0000","last_undegraded":"2024-04-25T13:16:16.354116+0000","last_fullsized":"2024-04-25T13:16:16.354116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246099+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:16.246099+0000","last_peered":"2024-04-25T13:16:16.246099+0000","last_clean":"2024-04-25T13:16:16.246099+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:16.246099+0000","last_undegraded":"2024-04-25T13:16:16.246099+0000","last_fullsized":"2024-04-25T13:16:16.246099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239499+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:15.239499+0000","last_peered":"2024-04-25T13:16:15.239499+0000","last_clean":"2024-04-25T13:16:15.239499+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:15.239499+0000","last_undegraded":"2024-04-25T13:16:15.239499+0000","last_fullsized":"2024-04-25T13:16:15.239499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353468+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:16.353468+0000","last_peered":"2024-04-25T13:16:16.353468+0000","last_clean":"2024-04-25T13:16:16.353468+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:16.353468+0000","last_undegraded":"2024-04-25T13:16:16.353468+0000","last_fullsized":"2024-04-25T13:16:16.353468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246276+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:16.246276+0000","last_peered":"2024-04-25T13:16:16.246276+0000","last_clean":"2024-04-25T13:16:16.246276+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:16.246276+0000","last_undegraded":"2024-04-25T13:16:16.246276+0000","last_fullsized":"2024-04-25T13:16:16.246276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353735+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:16.353735+0000","last_peered":"2024-04-25T13:16:16.353735+0000","last_clean":"2024-04-25T13:16:16.353735+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:16.353735+0000","last_undegraded":"2024-04-25T13:16:16.353735+0000","last_fullsized":"2024-04-25T13:16:16.353735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:24.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353518+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:16:16.353518+0000","last_peered":"2024-04-25T13:16:16.353518+0000","last_clean":"2024-04-25T13:16:16.353518+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:16:16.353518+0000","last_undegraded":"2024-04-25T13:16:16.353518+0000","last_fullsized":"2024-04-25T13:16:16.353518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:49.859293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353792+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:16.353792+0000","last_peered":"2024-04-25T13:16:16.353792+0000","last_clean":"2024-04-25T13:16:16.353792+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:16.353792+0000","last_undegraded":"2024-04-25T13:16:16.353792+0000","last_fullsized":"2024-04-25T13:16:16.353792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239616+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:15.239616+0000","last_peered":"2024-04-25T13:16:15.239616+0000","last_clean":"2024-04-25T13:16:15.239616+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:15.239616+0000","last_undegraded":"2024-04-25T13:16:15.239616+0000","last_fullsized":"2024-04-25T13:16:15.239616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:30.515181+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:16:30.515181+0000","last_peered":"2024-04-25T13:16:30.515181+0000","last_clean":"2024-04-25T13:16:30.515181+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:16:30.515181+0000","last_undegraded":"2024-04-25T13:16:30.515181+0000","last_fullsized":"2024-04-25T13:16:30.515181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353615+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:16.353615+0000","last_peered":"2024-04-25T13:16:16.353615+0000","last_clean":"2024-04-25T13:16:16.353615+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:16.353615+0000","last_undegraded":"2024-04-25T13:16:16.353615+0000","last_fullsized":"2024-04-25T13:16:16.353615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242098+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:15.242098+0000","last_peered":"2024-04-25T13:16:15.242098+0000","last_clean":"2024-04-25T13:16:15.242098+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:15.242098+0000","last_undegraded":"2024-04-25T13:16:15.242098+0000","last_fullsized":"2024-04-25T13:16:15.242098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354055+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:16.354055+0000","last_peered":"2024-04-25T13:16:16.354055+0000","last_clean":"2024-04-25T13:16:16.354055+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:16.354055+0000","last_undegraded":"2024-04-25T13:16:16.354055+0000","last_fullsized":"2024-04-25T13:16:16.354055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.242563+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:15.242563+0000","last_peered":"2024-04-25T13:16:15.242563+0000","last_clean":"2024-04-25T13:16:15.242563+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:15.242563+0000","last_undegraded":"2024-04-25T13:16:15.242563+0000","last_fullsized":"2024-04-25T13:16:15.242563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353633+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:16.353633+0000","last_peered":"2024-04-25T13:16:16.353633+0000","last_clean":"2024-04-25T13:16:16.353633+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:16.353633+0000","last_undegraded":"2024-04-25T13:16:16.353633+0000","last_fullsized":"2024-04-25T13:16:16.353633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:59.519018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353823+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:16:16.353823+0000","last_peered":"2024-04-25T13:16:16.353823+0000","last_clean":"2024-04-25T13:16:16.353823+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:16:16.353823+0000","last_undegraded":"2024-04-25T13:16:16.353823+0000","last_fullsized":"2024-04-25T13:16:16.353823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245632+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:16.245632+0000","last_peered":"2024-04-25T13:16:16.245632+0000","last_clean":"2024-04-25T13:16:16.245632+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:16.245632+0000","last_undegraded":"2024-04-25T13:16:16.245632+0000","last_fullsized":"2024-04-25T13:16:16.245632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353701+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:16.353701+0000","last_peered":"2024-04-25T13:16:16.353701+0000","last_clean":"2024-04-25T13:16:16.353701+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:16.353701+0000","last_undegraded":"2024-04-25T13:16:16.353701+0000","last_fullsized":"2024-04-25T13:16:16.353701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354545+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:16:16.354545+0000","last_peered":"2024-04-25T13:16:16.354545+0000","last_clean":"2024-04-25T13:16:16.354545+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:16:16.354545+0000","last_undegraded":"2024-04-25T13:16:16.354545+0000","last_fullsized":"2024-04-25T13:16:16.354545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245573+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:16.245573+0000","last_peered":"2024-04-25T13:16:16.245573+0000","last_clean":"2024-04-25T13:16:16.245573+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:16.245573+0000","last_undegraded":"2024-04-25T13:16:16.245573+0000","last_fullsized":"2024-04-25T13:16:16.245573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353911+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:16.353911+0000","last_peered":"2024-04-25T13:16:16.353911+0000","last_clean":"2024-04-25T13:16:16.353911+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:16.353911+0000","last_undegraded":"2024-04-25T13:16:16.353911+0000","last_fullsized":"2024-04-25T13:16:16.353911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.475502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353851+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:16.353851+0000","last_peered":"2024-04-25T13:16:16.353851+0000","last_clean":"2024-04-25T13:16:16.353851+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:16.353851+0000","last_undegraded":"2024-04-25T13:16:16.353851+0000","last_fullsized":"2024-04-25T13:16:16.353851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353153+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:16.353153+0000","last_peered":"2024-04-25T13:16:16.353153+0000","last_clean":"2024-04-25T13:16:16.353153+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:16.353153+0000","last_undegraded":"2024-04-25T13:16:16.353153+0000","last_fullsized":"2024-04-25T13:16:16.353153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354404+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:16.354404+0000","last_peered":"2024-04-25T13:16:16.354404+0000","last_clean":"2024-04-25T13:16:16.354404+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:16.354404+0000","last_undegraded":"2024-04-25T13:16:16.354404+0000","last_fullsized":"2024-04-25T13:16:16.354404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245598+0000","last_change":"2024-04-25T13:16:10.230726+0000","last_active":"2024-04-25T13:16:16.245598+0000","last_peered":"2024-04-25T13:16:16.245598+0000","last_clean":"2024-04-25T13:16:16.245598+0000","last_became_active":"2024-04-25T13:16:10.228712+0000","last_became_peered":"2024-04-25T13:16:10.228712+0000","last_unstale":"2024-04-25T13:16:16.245598+0000","last_undegraded":"2024-04-25T13:16:16.245598+0000","last_fullsized":"2024-04-25T13:16:16.245598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:43.499305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245839+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:16.245839+0000","last_peered":"2024-04-25T13:16:16.245839+0000","last_clean":"2024-04-25T13:16:16.245839+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:16.245839+0000","last_undegraded":"2024-04-25T13:16:16.245839+0000","last_fullsized":"2024-04-25T13:16:16.245839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354063+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:16.354063+0000","last_peered":"2024-04-25T13:16:16.354063+0000","last_clean":"2024-04-25T13:16:16.354063+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:16.354063+0000","last_undegraded":"2024-04-25T13:16:16.354063+0000","last_fullsized":"2024-04-25T13:16:16.354063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353420+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:16.353420+0000","last_peered":"2024-04-25T13:16:16.353420+0000","last_clean":"2024-04-25T13:16:16.353420+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:16.353420+0000","last_undegraded":"2024-04-25T13:16:16.353420+0000","last_fullsized":"2024-04-25T13:16:16.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238725+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:15.238725+0000","last_peered":"2024-04-25T13:16:15.238725+0000","last_clean":"2024-04-25T13:16:15.238725+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:15.238725+0000","last_undegraded":"2024-04-25T13:16:15.238725+0000","last_fullsized":"2024-04-25T13:16:15.238725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246106+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:16:16.246106+0000","last_peered":"2024-04-25T13:16:16.246106+0000","last_clean":"2024-04-25T13:16:16.246106+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:16:16.246106+0000","last_undegraded":"2024-04-25T13:16:16.246106+0000","last_fullsized":"2024-04-25T13:16:16.246106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241834+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:15.241834+0000","last_peered":"2024-04-25T13:16:15.241834+0000","last_clean":"2024-04-25T13:16:15.241834+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:15.241834+0000","last_undegraded":"2024-04-25T13:16:15.241834+0000","last_fullsized":"2024-04-25T13:16:15.241834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246117+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:16.246117+0000","last_peered":"2024-04-25T13:16:16.246117+0000","last_clean":"2024-04-25T13:16:16.246117+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:16.246117+0000","last_undegraded":"2024-04-25T13:16:16.246117+0000","last_fullsized":"2024-04-25T13:16:16.246117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353553+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:16.353553+0000","last_peered":"2024-04-25T13:16:16.353553+0000","last_clean":"2024-04-25T13:16:16.353553+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:16.353553+0000","last_undegraded":"2024-04-25T13:16:16.353553+0000","last_fullsized":"2024-04-25T13:16:16.353553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238557+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:15.238557+0000","last_peered":"2024-04-25T13:16:15.238557+0000","last_clean":"2024-04-25T13:16:15.238557+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:15.238557+0000","last_undegraded":"2024-04-25T13:16:15.238557+0000","last_fullsized":"2024-04-25T13:16:15.238557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353362+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:16.353362+0000","last_peered":"2024-04-25T13:16:16.353362+0000","last_clean":"2024-04-25T13:16:16.353362+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:16.353362+0000","last_undegraded":"2024-04-25T13:16:16.353362+0000","last_fullsized":"2024-04-25T13:16:16.353362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353399+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:16.353399+0000","last_peered":"2024-04-25T13:16:16.353399+0000","last_clean":"2024-04-25T13:16:16.353399+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:16.353399+0000","last_undegraded":"2024-04-25T13:16:16.353399+0000","last_fullsized":"2024-04-25T13:16:16.353399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:23.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246373+0000","last_change":"2024-04-25T13:16:10.236483+0000","last_active":"2024-04-25T13:16:16.246373+0000","last_peered":"2024-04-25T13:16:16.246373+0000","last_clean":"2024-04-25T13:16:16.246373+0000","last_became_active":"2024-04-25T13:16:10.236179+0000","last_became_peered":"2024-04-25T13:16:10.236179+0000","last_unstale":"2024-04-25T13:16:16.246373+0000","last_undegraded":"2024-04-25T13:16:16.246373+0000","last_fullsized":"2024-04-25T13:16:16.246373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:23.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354239+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:16.354239+0000","last_peered":"2024-04-25T13:16:16.354239+0000","last_clean":"2024-04-25T13:16:16.354239+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:16.354239+0000","last_undegraded":"2024-04-25T13:16:16.354239+0000","last_fullsized":"2024-04-25T13:16:16.354239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354433+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:16.354433+0000","last_peered":"2024-04-25T13:16:16.354433+0000","last_clean":"2024-04-25T13:16:16.354433+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:16.354433+0000","last_undegraded":"2024-04-25T13:16:16.354433+0000","last_fullsized":"2024-04-25T13:16:16.354433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.246083+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:16.246083+0000","last_peered":"2024-04-25T13:16:16.246083+0000","last_clean":"2024-04-25T13:16:16.246083+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:16.246083+0000","last_undegraded":"2024-04-25T13:16:16.246083+0000","last_fullsized":"2024-04-25T13:16:16.246083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353298+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:16.353298+0000","last_peered":"2024-04-25T13:16:16.353298+0000","last_clean":"2024-04-25T13:16:16.353298+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:16.353298+0000","last_undegraded":"2024-04-25T13:16:16.353298+0000","last_fullsized":"2024-04-25T13:16:16.353298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245689+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:16.245689+0000","last_peered":"2024-04-25T13:16:16.245689+0000","last_clean":"2024-04-25T13:16:16.245689+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:16.245689+0000","last_undegraded":"2024-04-25T13:16:16.245689+0000","last_fullsized":"2024-04-25T13:16:16.245689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353453+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:16.353453+0000","last_peered":"2024-04-25T13:16:16.353453+0000","last_clean":"2024-04-25T13:16:16.353453+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:16.353453+0000","last_undegraded":"2024-04-25T13:16:16.353453+0000","last_fullsized":"2024-04-25T13:16:16.353453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353184+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:16.353184+0000","last_peered":"2024-04-25T13:16:16.353184+0000","last_clean":"2024-04-25T13:16:16.353184+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:16.353184+0000","last_undegraded":"2024-04-25T13:16:16.353184+0000","last_fullsized":"2024-04-25T13:16:16.353184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:52.980650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354190+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:16.354190+0000","last_peered":"2024-04-25T13:16:16.354190+0000","last_clean":"2024-04-25T13:16:16.354190+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:16.354190+0000","last_undegraded":"2024-04-25T13:16:16.354190+0000","last_fullsized":"2024-04-25T13:16:16.354190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239903+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:15.239903+0000","last_peered":"2024-04-25T13:16:15.239903+0000","last_clean":"2024-04-25T13:16:15.239903+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:15.239903+0000","last_undegraded":"2024-04-25T13:16:15.239903+0000","last_fullsized":"2024-04-25T13:16:15.239903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.238907+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:15.238907+0000","last_peered":"2024-04-25T13:16:15.238907+0000","last_clean":"2024-04-25T13:16:15.238907+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:15.238907+0000","last_undegraded":"2024-04-25T13:16:15.238907+0000","last_fullsized":"2024-04-25T13:16:15.238907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354124+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:16.354124+0000","last_peered":"2024-04-25T13:16:16.354124+0000","last_clean":"2024-04-25T13:16:16.354124+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:16.354124+0000","last_undegraded":"2024-04-25T13:16:16.354124+0000","last_fullsized":"2024-04-25T13:16:16.354124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353029+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:16.353029+0000","last_peered":"2024-04-25T13:16:16.353029+0000","last_clean":"2024-04-25T13:16:16.353029+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:16.353029+0000","last_undegraded":"2024-04-25T13:16:16.353029+0000","last_fullsized":"2024-04-25T13:16:16.353029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353297+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:16.353297+0000","last_peered":"2024-04-25T13:16:16.353297+0000","last_clean":"2024-04-25T13:16:16.353297+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:16.353297+0000","last_undegraded":"2024-04-25T13:16:16.353297+0000","last_fullsized":"2024-04-25T13:16:16.353297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353364+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:16.353364+0000","last_peered":"2024-04-25T13:16:16.353364+0000","last_clean":"2024-04-25T13:16:16.353364+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:16.353364+0000","last_undegraded":"2024-04-25T13:16:16.353364+0000","last_fullsized":"2024-04-25T13:16:16.353364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:44.821443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245843+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:16.245843+0000","last_peered":"2024-04-25T13:16:16.245843+0000","last_clean":"2024-04-25T13:16:16.245843+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:16.245843+0000","last_undegraded":"2024-04-25T13:16:16.245843+0000","last_fullsized":"2024-04-25T13:16:16.245843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.241900+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:15.241900+0000","last_peered":"2024-04-25T13:16:15.241900+0000","last_clean":"2024-04-25T13:16:15.241900+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:15.241900+0000","last_undegraded":"2024-04-25T13:16:15.241900+0000","last_fullsized":"2024-04-25T13:16:15.241900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354206+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:16.354206+0000","last_peered":"2024-04-25T13:16:16.354206+0000","last_clean":"2024-04-25T13:16:16.354206+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:16.354206+0000","last_undegraded":"2024-04-25T13:16:16.354206+0000","last_fullsized":"2024-04-25T13:16:16.354206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.354360+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:16.354360+0000","last_peered":"2024-04-25T13:16:16.354360+0000","last_clean":"2024-04-25T13:16:16.354360+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:16.354360+0000","last_undegraded":"2024-04-25T13:16:16.354360+0000","last_fullsized":"2024-04-25T13:16:16.354360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239639+0000","last_change":"2024-04-25T13:16:10.239397+0000","last_active":"2024-04-25T13:16:15.239639+0000","last_peered":"2024-04-25T13:16:15.239639+0000","last_clean":"2024-04-25T13:16:15.239639+0000","last_became_active":"2024-04-25T13:16:10.239142+0000","last_became_peered":"2024-04-25T13:16:10.239142+0000","last_unstale":"2024-04-25T13:16:15.239639+0000","last_undegraded":"2024-04-25T13:16:15.239639+0000","last_fullsized":"2024-04-25T13:16:15.239639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:10.151896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.245495+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:16.245495+0000","last_peered":"2024-04-25T13:16:16.245495+0000","last_clean":"2024-04-25T13:16:16.245495+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:16.245495+0000","last_undegraded":"2024-04-25T13:16:16.245495+0000","last_fullsized":"2024-04-25T13:16:16.245495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239010+0000","last_change":"2024-04-25T13:16:10.224097+0000","last_active":"2024-04-25T13:16:15.239010+0000","last_peered":"2024-04-25T13:16:15.239010+0000","last_clean":"2024-04-25T13:16:15.239010+0000","last_became_active":"2024-04-25T13:16:10.222594+0000","last_became_peered":"2024-04-25T13:16:10.222594+0000","last_unstale":"2024-04-25T13:16:15.239010+0000","last_undegraded":"2024-04-25T13:16:15.239010+0000","last_fullsized":"2024-04-25T13:16:15.239010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:21.148411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353185+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:16.353185+0000","last_peered":"2024-04-25T13:16:16.353185+0000","last_clean":"2024-04-25T13:16:16.353185+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:16.353185+0000","last_undegraded":"2024-04-25T13:16:16.353185+0000","last_fullsized":"2024-04-25T13:16:16.353185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239336+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:15.239336+0000","last_peered":"2024-04-25T13:16:15.239336+0000","last_clean":"2024-04-25T13:16:15.239336+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:15.239336+0000","last_undegraded":"2024-04-25T13:16:15.239336+0000","last_fullsized":"2024-04-25T13:16:15.239336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353309+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:16.353309+0000","last_peered":"2024-04-25T13:16:16.353309+0000","last_clean":"2024-04-25T13:16:16.353309+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:16.353309+0000","last_undegraded":"2024-04-25T13:16:16.353309+0000","last_fullsized":"2024-04-25T13:16:16.353309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353609+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:16.353609+0000","last_peered":"2024-04-25T13:16:16.353609+0000","last_clean":"2024-04-25T13:16:16.353609+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:16.353609+0000","last_undegraded":"2024-04-25T13:16:16.353609+0000","last_fullsized":"2024-04-25T13:16:16.353609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:51.820664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:16.353877+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:16.353877+0000","last_peered":"2024-04-25T13:16:16.353877+0000","last_clean":"2024-04-25T13:16:16.353877+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:16.353877+0000","last_undegraded":"2024-04-25T13:16:16.353877+0000","last_fullsized":"2024-04-25T13:16:16.353877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T13:16:15.239431+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:15.239431+0000","last_peered":"2024-04-25T13:16:15.239431+0000","last_clean":"2024-04-25T13:16:15.239431+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:15.239431+0000","last_undegraded":"2024-04-25T13:16:15.239431+0000","last_fullsized":"2024-04-25T13:16:15.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":99976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":690982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:47.170 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:16:47.170 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T13:16:47.170 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T13:16:47.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.303+0000 7f47e6d36640 1 Processor -- start 2024-04-25T13:16:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.303+0000 7f47e6d36640 1 -- start start 2024-04-25T13:16:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47e6d36640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47e01553a0 0x7f47e00c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47e6d36640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e015bb80 0x7f47e00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47e6d36640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e006c850 con 0x7f47e00c8070 2024-04-25T13:16:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47e6d36640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f47e006cb30 con 0x7f47e01553a0 2024-04-25T13:16:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47e6d36640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f47e006ce10 con 0x7f47e015bb80 2024-04-25T13:16:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47e4ad2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47e01553a0 0x7f47e00c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47dffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f47e00c8070 0x7f47e00ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39312/0 (socket says 172.21.15.26:39312) 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47dffff640 1 -- 172.21.15.26:0/758900355 learned_addr learned my addr 172.21.15.26:0/758900355 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.304+0000 7f47e52d3640 1 --2- 172.21.15.26:0/758900355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e015bb80 0x7f47e00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47e4ad2640 1 -- 172.21.15.26:0/758900355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e015bb80 msgr2=0x7f47e00c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47e4ad2640 1 --2- 172.21.15.26:0/758900355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e015bb80 0x7f47e00c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47e4ad2640 1 -- 172.21.15.26:0/758900355 >> v1:172.21.15.26:6789/0 conn(0x7f47e00c8070 legacy=0x7f47e00ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47df7fe640 1 -- 172.21.15.26:0/758900355 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663569022 0 0) 0x7f47e006c850 con 0x7f47e00c8070 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47e4ad2640 1 -- 172.21.15.26:0/758900355 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e006d0f0 con 0x7f47e01553a0 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47e4ad2640 1 --2- 172.21.15.26:0/758900355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e01553a0 0x7f47e00c8700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009d90 tx=0x7f47d802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48233ac46142dae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47df7fe640 1 -- 172.21.15.26:0/758900355 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8007740 con 0x7f47e01553a0 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47df7fe640 1 -- 172.21.15.26:0/758900355 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d80078e0 con 0x7f47e01553a0 2024-04-25T13:16:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.305+0000 7f47df7fe640 1 -- 172.21.15.26:0/758900355 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8007cb0 con 0x7f47e01553a0 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 -- 172.21.15.26:0/758900355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e01553a0 msgr2=0x7f47e00c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 --2- 172.21.15.26:0/758900355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e01553a0 0x7f47e00c8700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009d90 tx=0x7f47d802a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 -- 172.21.15.26:0/758900355 shutdown_connections 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 --2- 172.21.15.26:0/758900355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e015bb80 0x7f47e00c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 --2- 172.21.15.26:0/758900355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e01553a0 0x7f47e00c8700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 -- 172.21.15.26:0/758900355 >> 172.21.15.26:0/758900355 conn(0x7f47e0073010 msgr2=0x7f47e0073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 -- 172.21.15.26:0/758900355 shutdown_connections 2024-04-25T13:16:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.306+0000 7f47e6d36640 1 -- 172.21.15.26:0/758900355 wait complete. 2024-04-25T13:16:47.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.307+0000 7f47e6d36640 1 Processor -- start 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.307+0000 7f47e6d36640 1 -- start start 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e6d36640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e00c8070 0x7f47e00c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e6d36640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e01553a0 0x7f47e0155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e6d36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e015bb80 0x7f47e01f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e6d36640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f47e00cd4d0 con 0x7f47e015bb80 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e6d36640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f47e0155780 con 0x7f47e00c8070 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e6d36640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f47e00cd650 con 0x7f47e01553a0 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e015bb80 0x7f47e01f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e015bb80 0x7f47e01f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52420/0 (socket says 172.21.15.26:52420) 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 -- 172.21.15.26:0/1546334605 learned_addr learned my addr 172.21.15.26:0/1546334605 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47dffff640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e01553a0 0x7f47e0155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e4ad2640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e00c8070 0x7f47e00c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 -- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e01553a0 msgr2=0x7f47e0155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e01553a0 0x7f47e0155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 -- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e00c8070 msgr2=0x7f47e00c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e00c8070 0x7f47e00c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47e52d3640 1 -- 172.21.15.26:0/1546334605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e00c5e70 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.308+0000 7f47dffff640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e01553a0 0x7f47e0155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.309+0000 7f47e52d3640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e015bb80 0x7f47e01f1440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e820 tx=0x7f47c800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.309+0000 7f47dd7fa640 1 -- 172.21.15.26:0/1546334605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8017070 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.309+0000 7f47dd7fa640 1 -- 172.21.15.26:0/1546334605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c800ee70 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.309+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e01f46c0 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.309+0000 7f47dd7fa640 1 -- 172.21.15.26:0/1546334605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c800cb60 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.309+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e01f4c80 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.310+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e00cda30 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.310+0000 7f47dd7fa640 1 -- 172.21.15.26:0/1546334605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f47c801a070 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.311+0000 7f47dd7fa640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f47c006c8f0 0x7f47c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.311+0000 7f47dd7fa640 1 -- 172.21.15.26:0/1546334605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f47c808bcf0 con 0x7f47e015bb80 2024-04-25T13:16:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.311+0000 7f47e4ad2640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f47c006c8f0 0x7f47c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.312+0000 7f47e4ad2640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f47c006c8f0 0x7f47c006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f47d8034000 tx=0x7f47d802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:47.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.315+0000 7f47dd7fa640 1 -- 172.21.15.26:0/1546334605 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47e00cda30 con 0x7f47e015bb80 2024-04-25T13:16:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.540+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f47e0068e40 con 0x7f47e015bb80 2024-04-25T13:16:47.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.540+0000 7f47dd7fa640 1 -- 172.21.15.26:0/1546334605 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f47c80596f0 con 0x7f47e015bb80 2024-04-25T13:16:47.541 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:47.541 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f47c006c8f0 msgr2=0x7f47c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f47c006c8f0 0x7f47c006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f47d8034000 tx=0x7f47d802f000 comp rx=0 tx=0).stop 2024-04-25T13:16:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e015bb80 msgr2=0x7f47e01f1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e015bb80 0x7f47e01f1440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e820 tx=0x7f47c800ec20 comp rx=0 tx=0).stop 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 shutdown_connections 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f47c006c8f0 0x7f47c006edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e015bb80 0x7f47e01f1440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e01553a0 0x7f47e0155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 --2- 172.21.15.26:0/1546334605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e00c8070 0x7f47e00c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 >> 172.21.15.26:0/1546334605 conn(0x7f47e0073010 msgr2=0x7f47e00ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 shutdown_connections 2024-04-25T13:16:47.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:47.542+0000 7f47e6d36640 1 -- 172.21.15.26:0/1546334605 wait complete. 2024-04-25T13:16:48.746 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-25T13:16:48.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T13:16:50.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:50.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.667+0000 7fe3f2d94640 1 Processor -- start 2024-04-25T13:16:50.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.667+0000 7fe3f2d94640 1 -- start start 2024-04-25T13:16:50.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3f2d94640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe3ec0c5f20 0x7fe3ec15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3f2d94640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec0ccf00 con 0x7fe3ec155170 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3f2d94640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec0cd1e0 con 0x7fe3ec155550 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3f2d94640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe3ec0cddf0 con 0x7fe3ec0c5f20 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3f0b30640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3ec155170 0x7fe3ec0d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39326/0 (socket says 172.21.15.26:39326) 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3f0b30640 1 -- 172.21.15.26:0/3645119401 learned_addr learned my addr 172.21.15.26:0/3645119401 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3f1331640 1 --2- 172.21.15.26:0/3645119401 >> v2:172.21.15.169:3300/0 conn(0x7fe3ec0c5f20 0x7fe3ec15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3eb7fe640 1 -- 172.21.15.26:0/3645119401 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837289386 0 0) 0x7fe3ec0ccf00 con 0x7fe3ec155170 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.668+0000 7fe3eb7fe640 1 -- 172.21.15.26:0/3645119401 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3dc003520 con 0x7fe3ec155170 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.669+0000 7fe3eb7fe640 1 -- 172.21.15.26:0/3645119401 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434421726 0 0) 0x7fe3ec0cd1e0 con 0x7fe3ec155550 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.669+0000 7fe3eb7fe640 1 -- 172.21.15.26:0/3645119401 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3ec0ccf00 con 0x7fe3ec155550 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.669+0000 7fe3f1331640 1 -- 172.21.15.26:0/3645119401 >> v1:172.21.15.169:6789/0 conn(0x7fe3ec155550 legacy=0x7fe3ec0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.669+0000 7fe3f1331640 1 -- 172.21.15.26:0/3645119401 >> v1:172.21.15.26:6789/0 conn(0x7fe3ec155170 legacy=0x7fe3ec0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.669+0000 7fe3f1331640 1 -- 172.21.15.26:0/3645119401 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec0cd4c0 con 0x7fe3ec0c5f20 2024-04-25T13:16:50.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.669+0000 7fe3f1331640 1 --2- 172.21.15.26:0/3645119401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec0c5f20 0x7fe3ec15eef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009d90 tx=0x7fe3e402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1816c9c69ffebf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:50.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3eb7fe640 1 -- 172.21.15.26:0/3645119401 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4007740 con 0x7fe3ec0c5f20 2024-04-25T13:16:50.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3eb7fe640 1 -- 172.21.15.26:0/3645119401 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e40078e0 con 0x7fe3ec0c5f20 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3eb7fe640 1 -- 172.21.15.26:0/3645119401 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4007cb0 con 0x7fe3ec0c5f20 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3f2d94640 1 -- 172.21.15.26:0/3645119401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec0c5f20 msgr2=0x7fe3ec15eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/3645119401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec0c5f20 0x7fe3ec15eef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009d90 tx=0x7fe3e402a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3f2d94640 1 -- 172.21.15.26:0/3645119401 shutdown_connections 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/3645119401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec0c5f20 0x7fe3ec15eef0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3f2d94640 1 -- 172.21.15.26:0/3645119401 >> 172.21.15.26:0/3645119401 conn(0x7fe3ec072570 msgr2=0x7fe3ec074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3f2d94640 1 -- 172.21.15.26:0/3645119401 shutdown_connections 2024-04-25T13:16:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.670+0000 7fe3f2d94640 1 -- 172.21.15.26:0/3645119401 wait complete. 2024-04-25T13:16:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.671+0000 7fe3f2d94640 1 Processor -- start 2024-04-25T13:16:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.671+0000 7fe3f2d94640 1 -- start start 2024-04-25T13:16:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f2d94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec155170 0x7fe3ec15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f2d94640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3ec155550 0x7fe3ec15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f2d94640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec15ef10 0x7fe3ec1f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f2d94640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec0cda80 con 0x7fe3ec155170 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f2d94640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec15f430 con 0x7fe3ec15ef10 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f2d94640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3ec0ccae0 con 0x7fe3ec155550 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f0b30640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec155170 0x7fe3ec15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f0b30640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec155170 0x7fe3ec15c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52434/0 (socket says 172.21.15.26:52434) 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f0b30640 1 -- 172.21.15.26:0/306519506 learned_addr learned my addr 172.21.15.26:0/306519506 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3ebfff640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3ec155550 0x7fe3ec15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.672+0000 7fe3f1331640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec15ef10 0x7fe3ec1f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f0b30640 1 -- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3ec155550 msgr2=0x7fe3ec15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f0b30640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3ec155550 0x7fe3ec15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f0b30640 1 -- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec15ef10 msgr2=0x7fe3ec1f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f0b30640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec15ef10 0x7fe3ec1f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f0b30640 1 -- 172.21.15.26:0/306519506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec0b65b0 con 0x7fe3ec155170 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f0b30640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec155170 0x7fe3ec15c120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c500 tx=0x7fe3e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3e97fa640 1 -- 172.21.15.26:0/306519506 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0017070 con 0x7fe3ec155170 2024-04-25T13:16:50.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3e97fa640 1 -- 172.21.15.26:0/306519506 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0005ce0 con 0x7fe3ec155170 2024-04-25T13:16:50.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec15c7b0 con 0x7fe3ec155170 2024-04-25T13:16:50.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3e97fa640 1 -- 172.21.15.26:0/306519506 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00072f0 con 0x7fe3ec155170 2024-04-25T13:16:50.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.673+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec1e46f0 con 0x7fe3ec155170 2024-04-25T13:16:50.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.674+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ec068e40 con 0x7fe3ec155170 2024-04-25T13:16:50.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.675+0000 7fe3e97fa640 1 -- 172.21.15.26:0/306519506 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe3e001a070 con 0x7fe3ec155170 2024-04-25T13:16:50.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.675+0000 7fe3e97fa640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe3d006c8f0 0x7fe3d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.675+0000 7fe3e97fa640 1 -- 172.21.15.26:0/306519506 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fe3e008b240 con 0x7fe3ec155170 2024-04-25T13:16:50.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.675+0000 7fe3ebfff640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe3d006c8f0 0x7fe3d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.676+0000 7fe3ebfff640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe3d006c8f0 0x7fe3d006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8007fd0 tx=0x7fe3d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.679+0000 7fe3e97fa640 1 -- 172.21.15.26:0/306519506 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe3e0058c70 con 0x7fe3ec155170 2024-04-25T13:16:50.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.903+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe3ec0cc2b0 con 0x7fe3ec155170 2024-04-25T13:16:50.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.903+0000 7fe3e97fa640 1 -- 172.21.15.26:0/306519506 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fe3e005cf70 con 0x7fe3ec155170 2024-04-25T13:16:50.904 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:50.904 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe3d006c8f0 msgr2=0x7fe3d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe3d006c8f0 0x7fe3d006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8007fd0 tx=0x7fe3d8009040 comp rx=0 tx=0).stop 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec155170 msgr2=0x7fe3ec15c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec155170 0x7fe3ec15c120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c500 tx=0x7fe3e000c9c0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 shutdown_connections 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe3d006c8f0 0x7fe3d006edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ec15ef10 0x7fe3ec1f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3ec155550 0x7fe3ec15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 --2- 172.21.15.26:0/306519506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec155170 0x7fe3ec15c120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 >> 172.21.15.26:0/306519506 conn(0x7fe3ec072570 msgr2=0x7fe3ec153490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 shutdown_connections 2024-04-25T13:16:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:50.905+0000 7fe3f2d94640 1 -- 172.21.15.26:0/306519506 wait complete. 2024-04-25T13:16:53.746 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-25T13:16:53.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T13:16:53.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.031+0000 7ff2c8168640 1 Processor -- start 2024-04-25T13:16:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.032+0000 7ff2c8168640 1 -- start start 2024-04-25T13:16:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c8168640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2c0155170 0x7ff2c015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c8168640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c00ccf00 con 0x7ff2c0155550 2024-04-25T13:16:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c8168640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c00cd1e0 con 0x7ff2c00cb9e0 2024-04-25T13:16:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c8168640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c00cddf0 con 0x7ff2c0155170 2024-04-25T13:16:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c5f04640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2c0155170 0x7ff2c015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c5703640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff2c0155550 0x7ff2c00d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36006/0 (socket says 172.21.15.26:36006) 2024-04-25T13:16:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c5703640 1 -- 172.21.15.26:0/1133000056 learned_addr learned my addr 172.21.15.26:0/1133000056 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c4f02640 1 -- 172.21.15.26:0/1133000056 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694681777 0 0) 0x7ff2c00ccf00 con 0x7ff2c0155550 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c4f02640 1 -- 172.21.15.26:0/1133000056 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2ac003520 con 0x7ff2c0155550 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c4f02640 1 -- 172.21.15.26:0/1133000056 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136488849 0 0) 0x7ff2c00cd1e0 con 0x7ff2c00cb9e0 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c5f04640 1 -- 172.21.15.26:0/1133000056 >> v1:172.21.15.169:6789/0 conn(0x7ff2c00cb9e0 legacy=0x7ff2c00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c5f04640 1 -- 172.21.15.26:0/1133000056 >> v1:172.21.15.26:6789/0 conn(0x7ff2c0155550 legacy=0x7ff2c00d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.033+0000 7ff2c5f04640 1 -- 172.21.15.26:0/1133000056 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c00cd4c0 con 0x7ff2c0155170 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.034+0000 7ff2c5f04640 1 --2- 172.21.15.26:0/1133000056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155170 0x7ff2c015eef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00cdf70 tx=0x7ff2bc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42af084cd7d8d69c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.034+0000 7ff2c4f02640 1 -- 172.21.15.26:0/1133000056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc037070 con 0x7ff2c0155170 2024-04-25T13:16:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.034+0000 7ff2c4f02640 1 -- 172.21.15.26:0/1133000056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc032440 con 0x7ff2c0155170 2024-04-25T13:16:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.034+0000 7ff2c4f02640 1 -- 172.21.15.26:0/1133000056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc032810 con 0x7ff2c0155170 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.035+0000 7ff2c8168640 1 -- 172.21.15.26:0/1133000056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155170 msgr2=0x7ff2c015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.035+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1133000056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155170 0x7ff2c015eef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00cdf70 tx=0x7ff2bc02a250 comp rx=0 tx=0).stop 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.035+0000 7ff2c8168640 1 -- 172.21.15.26:0/1133000056 shutdown_connections 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.035+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1133000056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155170 0x7ff2c015eef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.035+0000 7ff2c8168640 1 -- 172.21.15.26:0/1133000056 >> 172.21.15.26:0/1133000056 conn(0x7ff2c0072570 msgr2=0x7ff2c0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.035+0000 7ff2c8168640 1 -- 172.21.15.26:0/1133000056 shutdown_connections 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.035+0000 7ff2c8168640 1 -- 172.21.15.26:0/1133000056 wait complete. 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.036+0000 7ff2c8168640 1 Processor -- start 2024-04-25T13:16:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.036+0000 7ff2c8168640 1 -- start start 2024-04-25T13:16:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c8168640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2c00cb9e0 0x7ff2c01e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c8168640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2c0155170 0x7ff2c01e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c8168640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155550 0x7ff2c01f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c8168640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00cda80 con 0x7ff2c0155550 2024-04-25T13:16:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c8168640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c015f430 con 0x7ff2c00cb9e0 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c8168640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c00ccae0 con 0x7ff2c0155170 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155550 0x7ff2c01f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155550 0x7ff2c01f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39330/0 (socket says 172.21.15.26:39330) 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c5703640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2c0155170 0x7ff2c01e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c5f04640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2c00cb9e0 0x7ff2c01e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 -- 172.21.15.26:0/1728332352 learned_addr learned my addr 172.21.15.26:0/1728332352 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 -- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2c0155170 msgr2=0x7ff2c01e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2c0155170 0x7ff2c01e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 -- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2c00cb9e0 msgr2=0x7ff2c01e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2c00cb9e0 0x7ff2c01e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 -- 172.21.15.26:0/1728332352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c014e940 con 0x7ff2c0155550 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2c6705640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155550 0x7ff2c01f3cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c780 tx=0x7ff2b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.037+0000 7ff2b67fc640 1 -- 172.21.15.26:0/1728332352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8003da0 con 0x7ff2c0155550 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.038+0000 7ff2b67fc640 1 -- 172.21.15.26:0/1728332352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b800ce30 con 0x7ff2c0155550 2024-04-25T13:16:54.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.038+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c01e72f0 con 0x7ff2c0155550 2024-04-25T13:16:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.038+0000 7ff2b67fc640 1 -- 172.21.15.26:0/1728332352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8005290 con 0x7ff2c0155550 2024-04-25T13:16:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.038+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c01e7e70 con 0x7ff2c0155550 2024-04-25T13:16:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.039+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c0068e40 con 0x7ff2c0155550 2024-04-25T13:16:54.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.039+0000 7ff2b67fc640 1 -- 172.21.15.26:0/1728332352 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2b8005430 con 0x7ff2c0155550 2024-04-25T13:16:54.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.039+0000 7ff2b67fc640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff2a406c920 0x7ff2a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.040+0000 7ff2b67fc640 1 -- 172.21.15.26:0/1728332352 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7ff2b808bc50 con 0x7ff2c0155550 2024-04-25T13:16:54.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.040+0000 7ff2c5f04640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff2a406c920 0x7ff2a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.040+0000 7ff2c5f04640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff2a406c920 0x7ff2a406ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc034000 tx=0x7ff2bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.044+0000 7ff2b67fc640 1 -- 172.21.15.26:0/1728332352 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2b8091020 con 0x7ff2c0155550 2024-04-25T13:16:54.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.271+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2c00cc2b0 con 0x7ff2c0155550 2024-04-25T13:16:54.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.272+0000 7ff2b67fc640 1 -- 172.21.15.26:0/1728332352 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7ff2b80595f0 con 0x7ff2c0155550 2024-04-25T13:16:54.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:54.273 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff2a406c920 msgr2=0x7ff2a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff2a406c920 0x7ff2a406ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc034000 tx=0x7ff2bc02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155550 msgr2=0x7ff2c01f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155550 0x7ff2c01f3cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c780 tx=0x7ff2b800cc40 comp rx=0 tx=0).stop 2024-04-25T13:16:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 shutdown_connections 2024-04-25T13:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ff2a406c920 0x7ff2a406ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2c0155550 0x7ff2c01f3cd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2c0155170 0x7ff2c01e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 --2- 172.21.15.26:0/1728332352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2c00cb9e0 0x7ff2c01e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 >> 172.21.15.26:0/1728332352 conn(0x7ff2c0072570 msgr2=0x7ff2c015cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 shutdown_connections 2024-04-25T13:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:54.274+0000 7ff2c8168640 1 -- 172.21.15.26:0/1728332352 wait complete. 2024-04-25T13:16:57.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:57.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.399+0000 7f4489d30640 1 Processor -- start 2024-04-25T13:16:57.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.399+0000 7f4489d30640 1 -- start start 2024-04-25T13:16:57.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f4489d30640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4484155170 0x7f448415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f4489d30640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44840cb9e0 0x7f44840c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f4489d30640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44840ccf00 con 0x7f4484155550 2024-04-25T13:16:57.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f4489d30640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44840cddf0 con 0x7f4484155170 2024-04-25T13:16:57.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f4489d30640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f448415f430 con 0x7f44840cb9e0 2024-04-25T13:16:57.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4484155170 0x7f448415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4484155170 0x7f448415eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39334/0 (socket says 172.21.15.26:39334) 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44837fe640 1 -- 172.21.15.26:0/33318110 learned_addr learned my addr 172.21.15.26:0/33318110 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f4483fff640 1 --2- 172.21.15.26:0/33318110 >> v2:172.21.15.169:3300/0 conn(0x7f44840cb9e0 0x7f44840c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44837fe640 1 -- 172.21.15.26:0/33318110 >> v2:172.21.15.169:3300/0 conn(0x7f44840cb9e0 msgr2=0x7f44840c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44837fe640 1 --2- 172.21.15.26:0/33318110 >> v2:172.21.15.169:3300/0 conn(0x7f44840cb9e0 0x7f44840c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44837fe640 1 -- 172.21.15.26:0/33318110 >> v1:172.21.15.169:6789/0 conn(0x7f4484155550 legacy=0x7f44840d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44837fe640 1 -- 172.21.15.26:0/33318110 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44840cd1e0 con 0x7f4484155170 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.400+0000 7f44827fc640 1 -- 172.21.15.26:0/33318110 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393825453 0 0) 0x7f44840ccf00 con 0x7f4484155550 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.401+0000 7f44837fe640 1 --2- 172.21.15.26:0/33318110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4484155170 0x7f448415eef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4474009870 tx=0x7f447402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8cedf22a81f79d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.401+0000 7f44827fc640 1 -- 172.21.15.26:0/33318110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474037070 con 0x7f4484155170 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.401+0000 7f44827fc640 1 -- 172.21.15.26:0/33318110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4474032440 con 0x7f4484155170 2024-04-25T13:16:57.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.401+0000 7f44827fc640 1 -- 172.21.15.26:0/33318110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474032810 con 0x7f4484155170 2024-04-25T13:16:57.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 -- 172.21.15.26:0/33318110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4484155170 msgr2=0x7f448415eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 --2- 172.21.15.26:0/33318110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4484155170 0x7f448415eef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4474009870 tx=0x7f447402a2a0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 -- 172.21.15.26:0/33318110 shutdown_connections 2024-04-25T13:16:57.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 --2- 172.21.15.26:0/33318110 >> v2:172.21.15.169:3300/0 conn(0x7f44840cb9e0 0x7f44840c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 --2- 172.21.15.26:0/33318110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4484155170 0x7f448415eef0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 -- 172.21.15.26:0/33318110 >> 172.21.15.26:0/33318110 conn(0x7f4484072570 msgr2=0x7f4484074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:57.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 -- 172.21.15.26:0/33318110 shutdown_connections 2024-04-25T13:16:57.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.402+0000 7f4489d30640 1 -- 172.21.15.26:0/33318110 wait complete. 2024-04-25T13:16:57.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.403+0000 7f4489d30640 1 Processor -- start 2024-04-25T13:16:57.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.403+0000 7f4489d30640 1 -- start start 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4489d30640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44840cb9e0 0x7f44841f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4489d30640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4484155170 0x7f448414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4489d30640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4484155550 0x7f44841e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4489d30640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f44840cda80 con 0x7f44840cb9e0 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4489d30640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44840cd7a0 con 0x7f4484155170 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4489d30640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44840ccae0 con 0x7f4484155550 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f44837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44840cb9e0 0x7f44841f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f44837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44840cb9e0 0x7f44841f3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39346/0 (socket says 172.21.15.26:39346) 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f44837fe640 1 -- 172.21.15.26:0/3142741284 learned_addr learned my addr 172.21.15.26:0/3142741284 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4483fff640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4484155550 0x7f44841e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.404+0000 7f4482ffd640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4484155170 0x7f448414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f44837fe640 1 -- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4484155550 msgr2=0x7f44841e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f44837fe640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4484155550 0x7f44841e6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f44837fe640 1 -- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4484155170 msgr2=0x7f448414c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f44837fe640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4484155170 0x7f448414c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f44837fe640 1 -- 172.21.15.26:0/3142741284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44841e71c0 con 0x7f44840cb9e0 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f44837fe640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44840cb9e0 0x7f44841f3b40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4474009870 tx=0x7f44740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f446bfff640 1 -- 172.21.15.26:0/3142741284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474041020 con 0x7f44840cb9e0 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448414eb60 con 0x7f44840cb9e0 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f446bfff640 1 -- 172.21.15.26:0/3142741284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4474030640 con 0x7f44840cb9e0 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f446bfff640 1 -- 172.21.15.26:0/3142741284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474037040 con 0x7f44840cb9e0 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.405+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44841e63e0 con 0x7f44840cb9e0 2024-04-25T13:16:57.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.406+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4484068e40 con 0x7f44840cb9e0 2024-04-25T13:16:57.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.407+0000 7f446bfff640 1 -- 172.21.15.26:0/3142741284 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4474044020 con 0x7f44840cb9e0 2024-04-25T13:16:57.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.407+0000 7f446bfff640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f447006c8f0 0x7f447006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.407+0000 7f446bfff640 1 -- 172.21.15.26:0/3142741284 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f44740ac610 con 0x7f44840cb9e0 2024-04-25T13:16:57.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.407+0000 7f4482ffd640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f447006c8f0 0x7f447006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.408+0000 7f4482ffd640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f447006c8f0 0x7f447006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4484152630 tx=0x7f4478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:57.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.411+0000 7f446bfff640 1 -- 172.21.15.26:0/3142741284 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f447404b030 con 0x7f44840cb9e0 2024-04-25T13:16:57.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.635+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f44840cc2b0 con 0x7f44840cb9e0 2024-04-25T13:16:57.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.635+0000 7f446bfff640 1 -- 172.21.15.26:0/3142741284 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f44841e71c0 con 0x7f44840cb9e0 2024-04-25T13:16:57.635 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:57.635 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f447006c8f0 msgr2=0x7f447006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f447006c8f0 0x7f447006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4484152630 tx=0x7f4478009040 comp rx=0 tx=0).stop 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44840cb9e0 msgr2=0x7f44841f3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44840cb9e0 0x7f44841f3b40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4474009870 tx=0x7f44740046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 shutdown_connections 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f447006c8f0 0x7f447006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4484155550 0x7f44841e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4484155170 0x7f448414c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 --2- 172.21.15.26:0/3142741284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44840cb9e0 0x7f44841f3b40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 >> 172.21.15.26:0/3142741284 conn(0x7f4484072570 msgr2=0x7f4484153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 shutdown_connections 2024-04-25T13:16:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.637+0000 7f4489d30640 1 -- 172.21.15.26:0/3142741284 wait complete. 2024-04-25T13:16:57.648 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T13:16:57.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:57.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.749+0000 7fe65e176640 1 Processor -- start 2024-04-25T13:16:57.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.749+0000 7fe65e176640 1 -- start start 2024-04-25T13:16:57.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe65e176640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe65e176640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe6580c3900 0x7fe658161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe65e176640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe658158570 con 0x7fe658151b80 2024-04-25T13:16:57.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe65e176640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe6580c6f30 con 0x7fe6580c3900 2024-04-25T13:16:57.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe65e176640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580c8cc0 con 0x7fe6581517a0 2024-04-25T13:16:57.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe657fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe6580c3900 0x7fe658161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe656ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe658151b80 0x7fe65806ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36012/0 (socket says 172.21.15.26:36012) 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe656ffd640 1 -- 172.21.15.26:0/3111956977 learned_addr learned my addr 172.21.15.26:0/3111956977 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe6577fe640 1 --2- 172.21.15.26:0/3111956977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe657fff640 1 -- 172.21.15.26:0/3111956977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 msgr2=0x7fe6580c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe657fff640 1 --2- 172.21.15.26:0/3111956977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe657fff640 1 -- 172.21.15.26:0/3111956977 >> v1:172.21.15.26:6789/0 conn(0x7fe658151b80 legacy=0x7fe65806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.750+0000 7fe657fff640 1 -- 172.21.15.26:0/3111956977 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6580c71d0 con 0x7fe6580c3900 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.751+0000 7fe657fff640 1 --2- 172.21.15.26:0/3111956977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658161ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe65000aea0 tx=0x7fe65002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c61c5795c50f272 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.751+0000 7fe6567fc640 1 -- 172.21.15.26:0/3111956977 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650037070 con 0x7fe6580c3900 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.751+0000 7fe6567fc640 1 -- 172.21.15.26:0/3111956977 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe650008640 con 0x7fe6580c3900 2024-04-25T13:16:57.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.751+0000 7fe6567fc640 1 -- 172.21.15.26:0/3111956977 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650008a10 con 0x7fe6580c3900 2024-04-25T13:16:57.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 -- 172.21.15.26:0/3111956977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 msgr2=0x7fe658161ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 --2- 172.21.15.26:0/3111956977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658161ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe65000aea0 tx=0x7fe65002b7b0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 -- 172.21.15.26:0/3111956977 shutdown_connections 2024-04-25T13:16:57.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 --2- 172.21.15.26:0/3111956977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658161ea0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 --2- 172.21.15.26:0/3111956977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 -- 172.21.15.26:0/3111956977 >> 172.21.15.26:0/3111956977 conn(0x7fe6580c8f00 msgr2=0x7fe6580c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:57.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 -- 172.21.15.26:0/3111956977 shutdown_connections 2024-04-25T13:16:57.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.752+0000 7fe65e176640 1 -- 172.21.15.26:0/3111956977 wait complete. 2024-04-25T13:16:57.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.753+0000 7fe65e176640 1 Processor -- start 2024-04-25T13:16:57.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.753+0000 7fe65e176640 1 -- start start 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe65e176640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe65e176640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe65e176640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6581f2b70 0x7fe6581dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe65e176640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580c7a70 con 0x7fe6580c3900 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe65e176640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580c7790 con 0x7fe6581f2b70 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe65e176640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580c7f90 con 0x7fe6581517a0 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39378/0 (socket says 172.21.15.26:39378) 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 -- 172.21.15.26:0/1470365089 learned_addr learned my addr 172.21.15.26:0/1470365089 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe656ffd640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe657fff640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6581f2b70 0x7fe6581dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 -- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 msgr2=0x7fe6580737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 -- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6581f2b70 msgr2=0x7fe6581dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6581f2b70 0x7fe6581dd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.754+0000 7fe6577fe640 1 -- 172.21.15.26:0/1470365089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe658073d30 con 0x7fe6580c3900 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.755+0000 7fe6577fe640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658154760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe64800e9b0 tx=0x7fe64800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.755+0000 7fe63ffff640 1 -- 172.21.15.26:0/1470365089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648017070 con 0x7fe6580c3900 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.755+0000 7fe63ffff640 1 -- 172.21.15.26:0/1470365089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64800c9a0 con 0x7fe6580c3900 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.755+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6581521c0 con 0x7fe6580c3900 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.755+0000 7fe63ffff640 1 -- 172.21.15.26:0/1470365089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64800cd90 con 0x7fe6580c3900 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.755+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6581f2370 con 0x7fe6580c3900 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.756+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe658068e40 con 0x7fe6580c3900 2024-04-25T13:16:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.756+0000 7fe63ffff640 1 -- 172.21.15.26:0/1470365089 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe64801a070 con 0x7fe6580c3900 2024-04-25T13:16:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.757+0000 7fe63ffff640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe64406c920 0x7fe64406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.757+0000 7fe63ffff640 1 -- 172.21.15.26:0/1470365089 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fe64808bef0 con 0x7fe6580c3900 2024-04-25T13:16:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.757+0000 7fe656ffd640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe64406c920 0x7fe64406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.757+0000 7fe656ffd640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe64406c920 0x7fe64406ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe6581de660 tx=0x7fe64c007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:57.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.761+0000 7fe63ffff640 1 -- 172.21.15.26:0/1470365089 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6480597f0 con 0x7fe6580c3900 2024-04-25T13:16:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.946+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe65806fba0 con 0x7fe6580c3900 2024-04-25T13:16:57.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.947+0000 7fe63ffff640 1 -- 172.21.15.26:0/1470365089 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18947 (secure 0 0 0) 0x7fe64805daf0 con 0x7fe6580c3900 2024-04-25T13:16:57.947 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:57.947 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:50.350764+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe64406c920 msgr2=0x7fe64406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe64406c920 0x7fe64406ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe6581de660 tx=0x7fe64c007e80 comp rx=0 tx=0).stop 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 msgr2=0x7fe658154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658154760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe64800e9b0 tx=0x7fe64800ee70 comp rx=0 tx=0).stop 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 shutdown_connections 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe64406c920 0x7fe64406ede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6581f2b70 0x7fe6581dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6581517a0 0x7fe6580737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 --2- 172.21.15.26:0/1470365089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6580c3900 0x7fe658154760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 >> 172.21.15.26:0/1470365089 conn(0x7fe6580c8f00 msgr2=0x7fe6581e4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:57.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 shutdown_connections 2024-04-25T13:16:57.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:57.949+0000 7fe65e176640 1 -- 172.21.15.26:0/1470365089 wait complete. 2024-04-25T13:16:57.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:07.306201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:08.537870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:12.230813+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:57.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:58.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.064+0000 7fceec376640 1 Processor -- start 2024-04-25T13:16:58.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.064+0000 7fceec376640 1 -- start start 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.065+0000 7fceec376640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9cd0 0x7fcee40733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.065+0000 7fceec376640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee40c4850 con 0x7fcee4153230 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.065+0000 7fceec376640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee40c4290 con 0x7fcee40c9880 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.065+0000 7fceec376640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcee40c6590 con 0x7fcee40c9cd0 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fceea112640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcee4153230 0x7fcee40c3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36018/0 (socket says 172.21.15.26:36018) 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fceea112640 1 -- 172.21.15.26:0/304863193 learned_addr learned my addr 172.21.15.26:0/304863193 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fceea913640 1 --2- 172.21.15.26:0/304863193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9cd0 0x7fcee40733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fcee9110640 1 -- 172.21.15.26:0/304863193 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415481042 0 0) 0x7fcee40c4850 con 0x7fcee4153230 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fcee9110640 1 -- 172.21.15.26:0/304863193 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fced0003520 con 0x7fcee4153230 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fcee9110640 1 -- 172.21.15.26:0/304863193 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658319686 0 0) 0x7fcee40c4290 con 0x7fcee40c9880 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fceea913640 1 -- 172.21.15.26:0/304863193 >> v1:172.21.15.169:6789/0 conn(0x7fcee40c9880 legacy=0x7fcee4158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fceea913640 1 -- 172.21.15.26:0/304863193 >> v1:172.21.15.26:6789/0 conn(0x7fcee4153230 legacy=0x7fcee40c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.066+0000 7fceea913640 1 -- 172.21.15.26:0/304863193 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee40c4570 con 0x7fcee40c9cd0 2024-04-25T13:16:58.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceea913640 1 --2- 172.21.15.26:0/304863193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9cd0 0x7fcee40733e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcee40c6710 tx=0x7fcedc02a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57c67977efc35d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fcee9110640 1 -- 172.21.15.26:0/304863193 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc007740 con 0x7fcee40c9cd0 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fcee9110640 1 -- 172.21.15.26:0/304863193 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc0078e0 con 0x7fcee40c9cd0 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fcee9110640 1 -- 172.21.15.26:0/304863193 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc007cb0 con 0x7fcee40c9cd0 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceec376640 1 -- 172.21.15.26:0/304863193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9cd0 msgr2=0x7fcee40733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceec376640 1 --2- 172.21.15.26:0/304863193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9cd0 0x7fcee40733e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcee40c6710 tx=0x7fcedc02a750 comp rx=0 tx=0).stop 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceec376640 1 -- 172.21.15.26:0/304863193 shutdown_connections 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceec376640 1 --2- 172.21.15.26:0/304863193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9cd0 0x7fcee40733e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceec376640 1 -- 172.21.15.26:0/304863193 >> 172.21.15.26:0/304863193 conn(0x7fcee406d660 msgr2=0x7fcee4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceec376640 1 -- 172.21.15.26:0/304863193 shutdown_connections 2024-04-25T13:16:58.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.067+0000 7fceec376640 1 -- 172.21.15.26:0/304863193 wait complete. 2024-04-25T13:16:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.068+0000 7fceec376640 1 Processor -- start 2024-04-25T13:16:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceec376640 1 -- start start 2024-04-25T13:16:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceec376640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9880 0x7fcee40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceec376640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcee40c9cd0 0x7fcee4072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceec376640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcee4153230 0x7fcee4159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceec376640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40c6a20 con 0x7fcee40c9cd0 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceec376640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40c6220 con 0x7fcee4153230 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceec376640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcee4159540 con 0x7fcee40c9880 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fcee9911640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcee40c9cd0 0x7fcee4072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fcee9911640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcee40c9cd0 0x7fcee4072bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39382/0 (socket says 172.21.15.26:39382) 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fcee9911640 1 -- 172.21.15.26:0/894569272 learned_addr learned my addr 172.21.15.26:0/894569272 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceea112640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9880 0x7fcee40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.069+0000 7fceea913640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcee4153230 0x7fcee4159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcee9911640 1 -- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9880 msgr2=0x7fcee40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcee9911640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9880 0x7fcee40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcee9911640 1 -- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcee4153230 msgr2=0x7fcee4159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcee9911640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcee4153230 0x7fcee4159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcee9911640 1 -- 172.21.15.26:0/894569272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee415d020 con 0x7fcee40c9cd0 2024-04-25T13:16:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcee9911640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcee40c9cd0 0x7fcee4072bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fced400c4e0 tx=0x7fced400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcedaffd640 1 -- 172.21.15.26:0/894569272 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4017070 con 0x7fcee40c9cd0 2024-04-25T13:16:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcedaffd640 1 -- 172.21.15.26:0/894569272 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced40035f0 con 0x7fcee40c9cd0 2024-04-25T13:16:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee415c000 con 0x7fcee40c9cd0 2024-04-25T13:16:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fcedaffd640 1 -- 172.21.15.26:0/894569272 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced40039e0 con 0x7fcee40c9cd0 2024-04-25T13:16:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.070+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee415c5c0 con 0x7fcee40c9cd0 2024-04-25T13:16:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.071+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee4068f50 con 0x7fcee40c9cd0 2024-04-25T13:16:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.072+0000 7fcedaffd640 1 -- 172.21.15.26:0/894569272 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fced401a070 con 0x7fcee40c9cd0 2024-04-25T13:16:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.072+0000 7fcedaffd640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcec806c920 0x7fcec806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.072+0000 7fcedaffd640 1 -- 172.21.15.26:0/894569272 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fced408b1e0 con 0x7fcee40c9cd0 2024-04-25T13:16:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.072+0000 7fceea112640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcec806c920 0x7fcec806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.073+0000 7fceea112640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcec806c920 0x7fcec806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcee0005880 tx=0x7fcee0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.076+0000 7fcedaffd640 1 -- 172.21.15.26:0/894569272 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fced4058b80 con 0x7fcee40c9cd0 2024-04-25T13:16:58.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.262+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcee40c8e70 con 0x7fcee40c9cd0 2024-04-25T13:16:58.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.262+0000 7fcedaffd640 1 -- 172.21.15.26:0/894569272 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fced405ce80 con 0x7fcee40c9cd0 2024-04-25T13:16:58.262 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:16:58.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcec806c920 msgr2=0x7fcec806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcec806c920 0x7fcec806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcee0005880 tx=0x7fcee0009040 comp rx=0 tx=0).stop 2024-04-25T13:16:58.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcee40c9cd0 msgr2=0x7fcee4072bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcee40c9cd0 0x7fcee4072bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fced400c4e0 tx=0x7fced400c9a0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 shutdown_connections 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fcec806c920 0x7fcec806ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcee4153230 0x7fcee4159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcee40c9cd0 0x7fcee4072bc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 --2- 172.21.15.26:0/894569272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcee40c9880 0x7fcee40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 >> 172.21.15.26:0/894569272 conn(0x7fcee406d660 msgr2=0x7fcee40733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 shutdown_connections 2024-04-25T13:16:58.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.264+0000 7fceec376640 1 -- 172.21.15.26:0/894569272 wait complete. 2024-04-25T13:16:58.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:58.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.380+0000 7fb174d37640 1 Processor -- start 2024-04-25T13:16:58.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.380+0000 7fb174d37640 1 -- start start 2024-04-25T13:16:58.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb174d37640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb1701532c0 0x7fb1700c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb174d37640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb170070130 0x7fb17015c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb174d37640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb170074d50 con 0x7fb1700c4690 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb174d37640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb170075c00 con 0x7fb1701532c0 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb174d37640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb170074ff0 con 0x7fb170070130 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb167fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb1700c4690 0x7fb1700c6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36028/0 (socket says 172.21.15.26:36028) 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb167fff640 1 -- 172.21.15.26:0/3154584493 learned_addr learned my addr 172.21.15.26:0/3154584493 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb16e59c640 1 --2- 172.21.15.26:0/3154584493 >> v2:172.21.15.169:3300/0 conn(0x7fb1701532c0 0x7fb1700c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb16ed9d640 1 --2- 172.21.15.26:0/3154584493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb170070130 0x7fb17015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb16dd9b640 1 -- 172.21.15.26:0/3154584493 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333330236 0 0) 0x7fb170074d50 con 0x7fb1700c4690 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb16dd9b640 1 -- 172.21.15.26:0/3154584493 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb15c003520 con 0x7fb1700c4690 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb16ed9d640 1 -- 172.21.15.26:0/3154584493 >> v2:172.21.15.169:3300/0 conn(0x7fb1701532c0 msgr2=0x7fb1700c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb16ed9d640 1 --2- 172.21.15.26:0/3154584493 >> v2:172.21.15.169:3300/0 conn(0x7fb1701532c0 0x7fb1700c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.381+0000 7fb16ed9d640 1 -- 172.21.15.26:0/3154584493 >> v1:172.21.15.26:6789/0 conn(0x7fb1700c4690 legacy=0x7fb1700c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.382+0000 7fb16ed9d640 1 -- 172.21.15.26:0/3154584493 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700752d0 con 0x7fb170070130 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.382+0000 7fb16ed9d640 1 --2- 172.21.15.26:0/3154584493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb170070130 0x7fb17015c860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb170075d80 tx=0x7fb16802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74dc1acd6958a804 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.382+0000 7fb16dd9b640 1 -- 172.21.15.26:0/3154584493 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168007740 con 0x7fb170070130 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.382+0000 7fb16dd9b640 1 -- 172.21.15.26:0/3154584493 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1680078e0 con 0x7fb170070130 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.382+0000 7fb16dd9b640 1 -- 172.21.15.26:0/3154584493 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168007c90 con 0x7fb170070130 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 -- 172.21.15.26:0/3154584493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb170070130 msgr2=0x7fb17015c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 --2- 172.21.15.26:0/3154584493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb170070130 0x7fb17015c860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb170075d80 tx=0x7fb16802a6d0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 -- 172.21.15.26:0/3154584493 shutdown_connections 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 --2- 172.21.15.26:0/3154584493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb170070130 0x7fb17015c860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 --2- 172.21.15.26:0/3154584493 >> v2:172.21.15.169:3300/0 conn(0x7fb1701532c0 0x7fb1700c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 -- 172.21.15.26:0/3154584493 >> 172.21.15.26:0/3154584493 conn(0x7fb17006b920 msgr2=0x7fb17006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 -- 172.21.15.26:0/3154584493 shutdown_connections 2024-04-25T13:16:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.383+0000 7fb174d37640 1 -- 172.21.15.26:0/3154584493 wait complete. 2024-04-25T13:16:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.384+0000 7fb174d37640 1 Processor -- start 2024-04-25T13:16:58.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.384+0000 7fb174d37640 1 -- start start 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb174d37640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb170070130 0x7fb170156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb174d37640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1700c4690 0x7fb170159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb174d37640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1701532c0 0x7fb170153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb174d37640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb1701536a0 con 0x7fb170070130 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb174d37640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb170075890 con 0x7fb1701532c0 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb174d37640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700c76e0 con 0x7fb1700c4690 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb170070130 0x7fb170156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb170070130 0x7fb170156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39394/0 (socket says 172.21.15.26:39394) 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 -- 172.21.15.26:0/4060120008 learned_addr learned my addr 172.21.15.26:0/4060120008 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb167fff640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1700c4690 0x7fb170159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16ed9d640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1701532c0 0x7fb170153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 -- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1700c4690 msgr2=0x7fb170159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1700c4690 0x7fb170159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 -- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1701532c0 msgr2=0x7fb170153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1701532c0 0x7fb170153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.385+0000 7fb16e59c640 1 -- 172.21.15.26:0/4060120008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb170158620 con 0x7fb170070130 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.386+0000 7fb16e59c640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb170070130 0x7fb170156cf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb16000e9e0 tx=0x7fb16000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.386+0000 7fb166ffd640 1 -- 172.21.15.26:0/4060120008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160017070 con 0x7fb170070130 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.386+0000 7fb166ffd640 1 -- 172.21.15.26:0/4060120008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16000c970 con 0x7fb170070130 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.386+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1701f17b0 con 0x7fb170070130 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.386+0000 7fb166ffd640 1 -- 172.21.15.26:0/4060120008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16000cd60 con 0x7fb170070130 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.386+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb170158b70 con 0x7fb170070130 2024-04-25T13:16:58.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.387+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb170068e40 con 0x7fb170070130 2024-04-25T13:16:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.387+0000 7fb166ffd640 1 -- 172.21.15.26:0/4060120008 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb16001a070 con 0x7fb170070130 2024-04-25T13:16:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.388+0000 7fb166ffd640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb15006c8f0 0x7fb15006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.388+0000 7fb166ffd640 1 -- 172.21.15.26:0/4060120008 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb16008c2c0 con 0x7fb170070130 2024-04-25T13:16:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.388+0000 7fb167fff640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb15006c8f0 0x7fb15006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.388+0000 7fb167fff640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb15006c8f0 0x7fb15006edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1700cb490 tx=0x7fb158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.392+0000 7fb166ffd640 1 -- 172.21.15.26:0/4060120008 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb160059be0 con 0x7fb170070130 2024-04-25T13:16:58.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.578+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb1701527a0 con 0x7fb170070130 2024-04-25T13:16:58.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.579+0000 7fb166ffd640 1 -- 172.21.15.26:0/4060120008 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fb16005dee0 con 0x7fb170070130 2024-04-25T13:16:58.579 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:16:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb15006c8f0 msgr2=0x7fb15006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb15006c8f0 0x7fb15006edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1700cb490 tx=0x7fb158009040 comp rx=0 tx=0).stop 2024-04-25T13:16:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb170070130 msgr2=0x7fb170156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb170070130 0x7fb170156cf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb16000e9e0 tx=0x7fb16000eea0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 shutdown_connections 2024-04-25T13:16:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb15006c8f0 0x7fb15006edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1701532c0 0x7fb170153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1700c4690 0x7fb170159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 --2- 172.21.15.26:0/4060120008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb170070130 0x7fb170156cf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 >> 172.21.15.26:0/4060120008 conn(0x7fb17006b920 msgr2=0x7fb17006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 shutdown_connections 2024-04-25T13:16:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.581+0000 7fb174d37640 1 -- 172.21.15.26:0/4060120008 wait complete. 2024-04-25T13:16:58.592 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:58.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.696+0000 7fc3ad976640 1 Processor -- start 2024-04-25T13:16:58.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.696+0000 7fc3ad976640 1 -- start start 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3ad976640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3a8155530 0x7fc3a815f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3ad976640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80c58f0 0x7fc3a80c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3ad976640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a80cbe10 con 0x7fc3a80cccf0 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3ad976640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a815bf10 con 0x7fc3a8155530 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3ad976640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a80c6260 con 0x7fc3a80c58f0 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc39e7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc3a80cccf0 0x7fc3a80d09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36038/0 (socket says 172.21.15.26:36038) 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3a6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3a8155530 0x7fc3a815f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3a77fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80c58f0 0x7fc3a80c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc39e7fc640 1 -- 172.21.15.26:0/3772467232 learned_addr learned my addr 172.21.15.26:0/3772467232 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:58.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3a77fe640 1 -- 172.21.15.26:0/3772467232 >> v2:172.21.15.26:3300/0 conn(0x7fc3a8155530 msgr2=0x7fc3a815f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:58.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3a77fe640 1 --2- 172.21.15.26:0/3772467232 >> v2:172.21.15.26:3300/0 conn(0x7fc3a8155530 0x7fc3a815f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3a77fe640 1 -- 172.21.15.26:0/3772467232 >> v1:172.21.15.26:6789/0 conn(0x7fc3a80cccf0 legacy=0x7fc3a80d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.697+0000 7fc3a77fe640 1 -- 172.21.15.26:0/3772467232 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a80cc0d0 con 0x7fc3a80c58f0 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.698+0000 7fc3a77fe640 1 --2- 172.21.15.26:0/3772467232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80c58f0 0x7fc3a80c5d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009d90 tx=0x7fc3a002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e9d3741acc3935 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.698+0000 7fc3a67fc640 1 -- 172.21.15.26:0/3772467232 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0007740 con 0x7fc3a80c58f0 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.698+0000 7fc3a67fc640 1 -- 172.21.15.26:0/3772467232 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a00078e0 con 0x7fc3a80c58f0 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.698+0000 7fc3a67fc640 1 -- 172.21.15.26:0/3772467232 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0007cb0 con 0x7fc3a80c58f0 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 -- 172.21.15.26:0/3772467232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80c58f0 msgr2=0x7fc3a80c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 --2- 172.21.15.26:0/3772467232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80c58f0 0x7fc3a80c5d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009d90 tx=0x7fc3a002a660 comp rx=0 tx=0).stop 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 -- 172.21.15.26:0/3772467232 shutdown_connections 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 --2- 172.21.15.26:0/3772467232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80c58f0 0x7fc3a80c5d20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 --2- 172.21.15.26:0/3772467232 >> v2:172.21.15.26:3300/0 conn(0x7fc3a8155530 0x7fc3a815f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 -- 172.21.15.26:0/3772467232 >> 172.21.15.26:0/3772467232 conn(0x7fc3a806d350 msgr2=0x7fc3a8073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 -- 172.21.15.26:0/3772467232 shutdown_connections 2024-04-25T13:16:58.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.699+0000 7fc3ad976640 1 -- 172.21.15.26:0/3772467232 wait complete. 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.700+0000 7fc3ad976640 1 Processor -- start 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.700+0000 7fc3ad976640 1 -- start start 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80c58f0 0x7fc3a80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80cccf0 0x7fc3a8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3a8155530 0x7fc3a8158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a815bba0 con 0x7fc3a80c58f0 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a815b8c0 con 0x7fc3a8155530 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a815b290 con 0x7fc3a80cccf0 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80c58f0 0x7fc3a80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80c58f0 0x7fc3a80ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39402/0 (socket says 172.21.15.26:39402) 2024-04-25T13:16:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 -- 172.21.15.26:0/463598800 learned_addr learned my addr 172.21.15.26:0/463598800 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc39e7fc640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80cccf0 0x7fc3a8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a77fe640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3a8155530 0x7fc3a8158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 -- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80cccf0 msgr2=0x7fc3a8157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80cccf0 0x7fc3a8157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 -- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3a8155530 msgr2=0x7fc3a8158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3a8155530 0x7fc3a8158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 -- 172.21.15.26:0/463598800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a81e6960 con 0x7fc3a80c58f0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a6ffd640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80c58f0 0x7fc3a80ce910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc39800e870 tx=0x7fc39800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a4ff9640 1 -- 172.21.15.26:0/463598800 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398017070 con 0x7fc3a80c58f0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a4ff9640 1 -- 172.21.15.26:0/463598800 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39800c940 con 0x7fc3a80c58f0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a81e63a0 con 0x7fc3a80c58f0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3a4ff9640 1 -- 172.21.15.26:0/463598800 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39800cd30 con 0x7fc3a80c58f0 2024-04-25T13:16:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.701+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81e4780 con 0x7fc3a80c58f0 2024-04-25T13:16:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.702+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a8069ef0 con 0x7fc3a80c58f0 2024-04-25T13:16:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.703+0000 7fc3a4ff9640 1 -- 172.21.15.26:0/463598800 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc39801a070 con 0x7fc3a80c58f0 2024-04-25T13:16:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.703+0000 7fc3a4ff9640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc38806c8f0 0x7fc38806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.704+0000 7fc3a4ff9640 1 -- 172.21.15.26:0/463598800 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fc39808bd20 con 0x7fc3a80c58f0 2024-04-25T13:16:58.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.704+0000 7fc39e7fc640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc38806c8f0 0x7fc38806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.704+0000 7fc39e7fc640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc38806c8f0 0x7fc38806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80cb280 tx=0x7fc390007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.708+0000 7fc3a4ff9640 1 -- 172.21.15.26:0/463598800 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc398059750 con 0x7fc3a80c58f0 2024-04-25T13:16:58.746 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-25T13:16:58.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-25T13:16:58.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.891+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc3a8073290 con 0x7fc3a80c58f0 2024-04-25T13:16:58.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.891+0000 7fc3a4ff9640 1 -- 172.21.15.26:0/463598800 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fc39805da50 con 0x7fc3a80c58f0 2024-04-25T13:16:58.891 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-25T13:16:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc38806c8f0 msgr2=0x7fc38806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc38806c8f0 0x7fc38806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80cb280 tx=0x7fc390007e80 comp rx=0 tx=0).stop 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80c58f0 msgr2=0x7fc3a80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80c58f0 0x7fc3a80ce910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc39800e870 tx=0x7fc39800ed30 comp rx=0 tx=0).stop 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 shutdown_connections 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc38806c8f0 0x7fc38806edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3a8155530 0x7fc3a8158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3a80cccf0 0x7fc3a8157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 --2- 172.21.15.26:0/463598800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80c58f0 0x7fc3a80ce910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 >> 172.21.15.26:0/463598800 conn(0x7fc3a806d350 msgr2=0x7fc3a8159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 shutdown_connections 2024-04-25T13:16:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:58.893+0000 7fc3ad976640 1 -- 172.21.15.26:0/463598800 wait complete. 2024-04-25T13:16:58.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:59.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.008+0000 7f41658f5640 1 Processor -- start 2024-04-25T13:16:59.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.008+0000 7f41658f5640 1 -- start start 2024-04-25T13:16:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f41658f5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41600cb270 0x7f416006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f41658f5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f41600c60c0 0x7f41600c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f41658f5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41600c5900 con 0x7f4160155220 2024-04-25T13:16:59.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f41658f5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f416015c040 con 0x7f41600cb270 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f41658f5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f41600c6a70 con 0x7f41600c60c0 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415e7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41600cb270 0x7f416006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4160155220 0x7f41600d0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36050/0 (socket says 172.21.15.26:36050) 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415effd640 1 -- 172.21.15.26:0/1589371399 learned_addr learned my addr 172.21.15.26:0/1589371399 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415f7fe640 1 --2- 172.21.15.26:0/1589371399 >> v2:172.21.15.169:3300/0 conn(0x7f41600c60c0 0x7f41600c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415e7fc640 1 -- 172.21.15.26:0/1589371399 >> v2:172.21.15.169:3300/0 conn(0x7f41600c60c0 msgr2=0x7f41600c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415e7fc640 1 --2- 172.21.15.26:0/1589371399 >> v2:172.21.15.169:3300/0 conn(0x7f41600c60c0 0x7f41600c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415e7fc640 1 -- 172.21.15.26:0/1589371399 >> v1:172.21.15.26:6789/0 conn(0x7f4160155220 legacy=0x7f41600d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415dffb640 1 -- 172.21.15.26:0/1589371399 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850925001 0 0) 0x7f41600c5900 con 0x7f4160155220 2024-04-25T13:16:59.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.009+0000 7f415e7fc640 1 -- 172.21.15.26:0/1589371399 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41600cc4f0 con 0x7f41600cb270 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.010+0000 7f415e7fc640 1 --2- 172.21.15.26:0/1589371399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41600cb270 0x7f416006d510 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41600b5ea0 tx=0x7f414802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a979af73c1f78cea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.010+0000 7f415dffb640 1 -- 172.21.15.26:0/1589371399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148037070 con 0x7f41600cb270 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.010+0000 7f415dffb640 1 -- 172.21.15.26:0/1589371399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4148032440 con 0x7f41600cb270 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.010+0000 7f415dffb640 1 -- 172.21.15.26:0/1589371399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148032810 con 0x7f41600cb270 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 -- 172.21.15.26:0/1589371399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41600cb270 msgr2=0x7f416006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 --2- 172.21.15.26:0/1589371399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41600cb270 0x7f416006d510 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41600b5ea0 tx=0x7f414802a230 comp rx=0 tx=0).stop 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 -- 172.21.15.26:0/1589371399 shutdown_connections 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 --2- 172.21.15.26:0/1589371399 >> v2:172.21.15.169:3300/0 conn(0x7f41600c60c0 0x7f41600c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 --2- 172.21.15.26:0/1589371399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41600cb270 0x7f416006d510 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 -- 172.21.15.26:0/1589371399 >> 172.21.15.26:0/1589371399 conn(0x7f4160075170 msgr2=0x7f4160075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 -- 172.21.15.26:0/1589371399 shutdown_connections 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.011+0000 7f41658f5640 1 -- 172.21.15.26:0/1589371399 wait complete. 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.012+0000 7f41658f5640 1 Processor -- start 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.012+0000 7f41658f5640 1 -- start start 2024-04-25T13:16:59.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f41658f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41600c60c0 0x7f41600b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f41658f5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41600cb270 0x7f41601461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f41658f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4160155220 0x7f41601e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f41658f5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f41600c5c30 con 0x7f4160155220 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f41658f5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f416015bd60 con 0x7f41600c60c0 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f41658f5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4160155600 con 0x7f41600cb270 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4160155220 0x7f41601e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4160155220 0x7f41601e5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39420/0 (socket says 172.21.15.26:39420) 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 -- 172.21.15.26:0/3736038412 learned_addr learned my addr 172.21.15.26:0/3736038412 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415e7fc640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41600cb270 0x7f41601461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415effd640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41600c60c0 0x7f41600b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 -- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41600cb270 msgr2=0x7f41601461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41600cb270 0x7f41601461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 -- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41600c60c0 msgr2=0x7f41600b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41600c60c0 0x7f41600b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 -- 172.21.15.26:0/3736038412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416015ef80 con 0x7f4160155220 2024-04-25T13:16:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.013+0000 7f415f7fe640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4160155220 0x7f41601e5910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f415000efc0 tx=0x7f415000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.014+0000 7f4157fff640 1 -- 172.21.15.26:0/3736038412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150018020 con 0x7f4160155220 2024-04-25T13:16:59.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.014+0000 7f4157fff640 1 -- 172.21.15.26:0/3736038412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4150014480 con 0x7f4160155220 2024-04-25T13:16:59.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.014+0000 7f4157fff640 1 -- 172.21.15.26:0/3736038412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150014870 con 0x7f4160155220 2024-04-25T13:16:59.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.014+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41601e45d0 con 0x7f4160155220 2024-04-25T13:16:59.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.014+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41601e4b90 con 0x7f4160155220 2024-04-25T13:16:59.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.015+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4160068e40 con 0x7f4160155220 2024-04-25T13:16:59.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.015+0000 7f4157fff640 1 -- 172.21.15.26:0/3736038412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4150005d10 con 0x7f4160155220 2024-04-25T13:16:59.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.016+0000 7f4157fff640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f414006c8f0 0x7f414006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.016+0000 7f4157fff640 1 -- 172.21.15.26:0/3736038412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f415008c9e0 con 0x7f4160155220 2024-04-25T13:16:59.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.016+0000 7f415effd640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f414006c8f0 0x7f414006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.016+0000 7f415effd640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f414006c8f0 0x7f414006edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4158007fd0 tx=0x7f4158007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.020+0000 7f4157fff640 1 -- 172.21.15.26:0/3736038412 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4150022070 con 0x7f4160155220 2024-04-25T13:16:59.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.205+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f41600cb7a0 con 0x7f4160155220 2024-04-25T13:16:59.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.206+0000 7f4157fff640 1 -- 172.21.15.26:0/3736038412 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f4150010040 con 0x7f4160155220 2024-04-25T13:16:59.206 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f414006c8f0 msgr2=0x7f414006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f414006c8f0 0x7f414006edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4158007fd0 tx=0x7f4158007de0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4160155220 msgr2=0x7f41601e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4160155220 0x7f41601e5910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f415000efc0 tx=0x7f415000c490 comp rx=0 tx=0).stop 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 shutdown_connections 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f414006c8f0 0x7f414006edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4160155220 0x7f41601e5910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41600cb270 0x7f41601461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 --2- 172.21.15.26:0/3736038412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41600c60c0 0x7f41600b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 >> 172.21.15.26:0/3736038412 conn(0x7f4160075170 msgr2=0x7f41601e7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 shutdown_connections 2024-04-25T13:16:59.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.208+0000 7f41658f5640 1 -- 172.21.15.26:0/3736038412 wait complete. 2024-04-25T13:16:59.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:59.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.319+0000 7fbf9d7f7640 1 Processor -- start 2024-04-25T13:16:59.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.319+0000 7fbf9d7f7640 1 -- start start 2024-04-25T13:16:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf9d7f7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf9815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf9d7f7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf980b3c00 0x7fbf980b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf9d7f7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbf980b5450 0x7fbf980d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf9d7f7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbf980b4a80 con 0x7fbf980b3c00 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf9d7f7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbf981558c0 con 0x7fbf980b5450 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf9d7f7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9815f630 con 0x7fbf981554e0 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf967fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf980b3c00 0x7fbf980b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf967fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf980b3c00 0x7fbf980b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39424/0 (socket says 172.21.15.26:39424) 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf96ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf9815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf967fc640 1 -- 172.21.15.26:0/3018239561 learned_addr learned my addr 172.21.15.26:0/3018239561 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf977fe640 1 --2- 172.21.15.26:0/3018239561 >> v2:172.21.15.169:3300/0 conn(0x7fbf980b5450 0x7fbf980d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf96ffd640 1 -- 172.21.15.26:0/3018239561 >> v2:172.21.15.169:3300/0 conn(0x7fbf980b5450 msgr2=0x7fbf980d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf96ffd640 1 --2- 172.21.15.26:0/3018239561 >> v2:172.21.15.169:3300/0 conn(0x7fbf980b5450 0x7fbf980d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf96ffd640 1 -- 172.21.15.26:0/3018239561 >> v2:172.21.15.26:3300/0 conn(0x7fbf980b3c00 msgr2=0x7fbf980b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf96ffd640 1 --2- 172.21.15.26:0/3018239561 >> v2:172.21.15.26:3300/0 conn(0x7fbf980b3c00 0x7fbf980b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.320+0000 7fbf96ffd640 1 -- 172.21.15.26:0/3018239561 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf980cb8c0 con 0x7fbf981554e0 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.321+0000 7fbf96ffd640 1 --2- 172.21.15.26:0/3018239561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf9815f0f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf980caf10 tx=0x7fbf9002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a9c8fbeced2b459 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.321+0000 7fbf95ffb640 1 -- 172.21.15.26:0/3018239561 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90037070 con 0x7fbf981554e0 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.321+0000 7fbf95ffb640 1 -- 172.21.15.26:0/3018239561 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf90032440 con 0x7fbf981554e0 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.321+0000 7fbf95ffb640 1 -- 172.21.15.26:0/3018239561 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90032810 con 0x7fbf981554e0 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/3018239561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 msgr2=0x7fbf9815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/3018239561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf9815f0f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf980caf10 tx=0x7fbf9002a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/3018239561 shutdown_connections 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/3018239561 >> v2:172.21.15.26:3300/0 conn(0x7fbf980b3c00 0x7fbf980b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/3018239561 >> v2:172.21.15.169:3300/0 conn(0x7fbf980b5450 0x7fbf980d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/3018239561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf9815f0f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/3018239561 >> 172.21.15.26:0/3018239561 conn(0x7fbf98074d50 msgr2=0x7fbf98075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/3018239561 shutdown_connections 2024-04-25T13:16:59.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.322+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/3018239561 wait complete. 2024-04-25T13:16:59.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.323+0000 7fbf9d7f7640 1 Processor -- start 2024-04-25T13:16:59.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.323+0000 7fbf9d7f7640 1 -- start start 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf9d7f7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf980b3c00 0x7fbf9815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf9d7f7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf980b5450 0x7fbf981f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf9d7f7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf981e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf9d7f7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbf980b4430 con 0x7fbf980b3c00 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf9d7f7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf980b4150 con 0x7fbf980b5450 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf9d7f7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbf980b4710 con 0x7fbf981554e0 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf980b3c00 0x7fbf9815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf980b3c00 0x7fbf9815bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39428/0 (socket says 172.21.15.26:39428) 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 -- 172.21.15.26:0/70260831 learned_addr learned my addr 172.21.15.26:0/70260831 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf977fe640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf981e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf967fc640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf980b5450 0x7fbf981f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 -- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 msgr2=0x7fbf981e4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf981e4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 -- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf980b5450 msgr2=0x7fbf981f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf980b5450 0x7fbf981f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.324+0000 7fbf96ffd640 1 -- 172.21.15.26:0/70260831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf981f0fa0 con 0x7fbf980b3c00 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.325+0000 7fbf96ffd640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf980b3c00 0x7fbf9815bca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf90000c00 tx=0x7fbf900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.325+0000 7fbf7f7fe640 1 -- 172.21.15.26:0/70260831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90041020 con 0x7fbf980b3c00 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.325+0000 7fbf7f7fe640 1 -- 172.21.15.26:0/70260831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9003d620 con 0x7fbf980b3c00 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.325+0000 7fbf7f7fe640 1 -- 172.21.15.26:0/70260831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90037040 con 0x7fbf980b3c00 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.325+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf981e4a80 con 0x7fbf980b3c00 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.325+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf980c8550 con 0x7fbf980b3c00 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.326+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf98068e40 con 0x7fbf980b3c00 2024-04-25T13:16:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.326+0000 7fbf7f7fe640 1 -- 172.21.15.26:0/70260831 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf90044020 con 0x7fbf980b3c00 2024-04-25T13:16:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.326+0000 7fbf7f7fe640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbf8406c920 0x7fbf8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.327+0000 7fbf7f7fe640 1 -- 172.21.15.26:0/70260831 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fbf900ac540 con 0x7fbf980b3c00 2024-04-25T13:16:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.327+0000 7fbf967fc640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbf8406c920 0x7fbf8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.327+0000 7fbf967fc640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbf8406c920 0x7fbf8406ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbf9815f600 tx=0x7fbf8c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.331+0000 7fbf7f7fe640 1 -- 172.21.15.26:0/70260831 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf9004b030 con 0x7fbf980b3c00 2024-04-25T13:16:59.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.555+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf980cc260 con 0x7fbf980b3c00 2024-04-25T13:16:59.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.556+0000 7fbf7f7fe640 1 -- 172.21.15.26:0/70260831 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7fbf981f0fa0 con 0x7fbf980b3c00 2024-04-25T13:16:59.556 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:59.556 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:57.377490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4308,"mds_1":4305,"mds_2":4284,"mds_3":4279,"mds_4":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308,4284,4305,4279]},"id":1}]} 2024-04-25T13:16:59.557 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2024-04-25T13:16:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbf8406c920 msgr2=0x7fbf8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbf8406c920 0x7fbf8406ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbf9815f600 tx=0x7fbf8c009240 comp rx=0 tx=0).stop 2024-04-25T13:16:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf980b3c00 msgr2=0x7fbf9815bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf980b3c00 0x7fbf9815bca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf90000c00 tx=0x7fbf900046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 shutdown_connections 2024-04-25T13:16:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbf8406c920 0x7fbf8406ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf981554e0 0x7fbf981e4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf980b5450 0x7fbf981f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 --2- 172.21.15.26:0/70260831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf980b3c00 0x7fbf9815bca0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 >> 172.21.15.26:0/70260831 conn(0x7fbf98074d50 msgr2=0x7fbf980c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 shutdown_connections 2024-04-25T13:16:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.558+0000 7fbf9d7f7640 1 -- 172.21.15.26:0/70260831 wait complete. 2024-04-25T13:16:59.569 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.670+0000 7fb230336640 1 Processor -- start 2024-04-25T13:16:59.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.670+0000 7fb230336640 1 -- start start 2024-04-25T13:16:59.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb230336640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2281554e0 0x7fb22815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb230336640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb2280b3c00 0x7fb2280b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb230336640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2280b5450 0x7fb2280d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb230336640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb2280b4a80 con 0x7fb2281554e0 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb230336640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb2281558c0 con 0x7fb2280b3c00 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb230336640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb22815f630 con 0x7fb2280b5450 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb22e0d2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2281554e0 0x7fb22815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb22e0d2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2281554e0 0x7fb22815f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39438/0 (socket says 172.21.15.26:39438) 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb22e0d2640 1 -- 172.21.15.26:0/2519641968 learned_addr learned my addr 172.21.15.26:0/2519641968 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb22e8d3640 1 --2- 172.21.15.26:0/2519641968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2280b5450 0x7fb2280d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.671+0000 7fb22d8d1640 1 --2- 172.21.15.26:0/2519641968 >> v2:172.21.15.169:3300/0 conn(0x7fb2280b3c00 0x7fb2280b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22e0d2640 1 -- 172.21.15.26:0/2519641968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2280b5450 msgr2=0x7fb2280d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22e0d2640 1 --2- 172.21.15.26:0/2519641968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2280b5450 0x7fb2280d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22e0d2640 1 -- 172.21.15.26:0/2519641968 >> v2:172.21.15.169:3300/0 conn(0x7fb2280b3c00 msgr2=0x7fb2280b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22e0d2640 1 --2- 172.21.15.26:0/2519641968 >> v2:172.21.15.169:3300/0 conn(0x7fb2280b3c00 0x7fb2280b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22e0d2640 1 -- 172.21.15.26:0/2519641968 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2280cb8c0 con 0x7fb2281554e0 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22e0d2640 1 --2- 172.21.15.26:0/2519641968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2281554e0 0x7fb22815f0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ce7e0 tx=0x7fb22002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dfdc7e4e8b7f90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22d0d0640 1 -- 172.21.15.26:0/2519641968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220037070 con 0x7fb2281554e0 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22d0d0640 1 -- 172.21.15.26:0/2519641968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb220032440 con 0x7fb2281554e0 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.672+0000 7fb22d0d0640 1 -- 172.21.15.26:0/2519641968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220032810 con 0x7fb2281554e0 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 -- 172.21.15.26:0/2519641968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2281554e0 msgr2=0x7fb22815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 --2- 172.21.15.26:0/2519641968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2281554e0 0x7fb22815f0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ce7e0 tx=0x7fb22002a270 comp rx=0 tx=0).stop 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 -- 172.21.15.26:0/2519641968 shutdown_connections 2024-04-25T13:16:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 --2- 172.21.15.26:0/2519641968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2280b5450 0x7fb2280d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 --2- 172.21.15.26:0/2519641968 >> v2:172.21.15.169:3300/0 conn(0x7fb2280b3c00 0x7fb2280b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 --2- 172.21.15.26:0/2519641968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2281554e0 0x7fb22815f0f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 -- 172.21.15.26:0/2519641968 >> 172.21.15.26:0/2519641968 conn(0x7fb228074d50 msgr2=0x7fb228075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 -- 172.21.15.26:0/2519641968 shutdown_connections 2024-04-25T13:16:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.673+0000 7fb230336640 1 -- 172.21.15.26:0/2519641968 wait complete. 2024-04-25T13:16:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.674+0000 7fb230336640 1 Processor -- start 2024-04-25T13:16:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.674+0000 7fb230336640 1 -- start start 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb230336640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2280b3c00 0x7fb2281f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb230336640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2280b5450 0x7fb2281e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb230336640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2281554e0 0x7fb22815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb230336640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280b4430 con 0x7fb2280b5450 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb230336640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280b4150 con 0x7fb2280b3c00 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb230336640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb2280b4710 con 0x7fb2281554e0 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2280b5450 0x7fb2281e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2280b5450 0x7fb2281e52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39442/0 (socket says 172.21.15.26:39442) 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 -- 172.21.15.26:0/3153135405 learned_addr learned my addr 172.21.15.26:0/3153135405 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22e0d2640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2280b3c00 0x7fb2281f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22e8d3640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2281554e0 0x7fb22815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 -- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2281554e0 msgr2=0x7fb22815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2281554e0 0x7fb22815c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 -- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2280b3c00 msgr2=0x7fb2281f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2280b3c00 0x7fb2281f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.675+0000 7fb22d8d1640 1 -- 172.21.15.26:0/3153135405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2281f1550 con 0x7fb2280b5450 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.676+0000 7fb22d8d1640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2280b5450 0x7fb2281e52c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00e870 tx=0x7fb21c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.676+0000 7fb226ffd640 1 -- 172.21.15.26:0/3153135405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c017070 con 0x7fb2280b5450 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.676+0000 7fb226ffd640 1 -- 172.21.15.26:0/3153135405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c00ee60 con 0x7fb2280b5450 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.676+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2281e5c80 con 0x7fb2280b5450 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.676+0000 7fb226ffd640 1 -- 172.21.15.26:0/3153135405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00cb80 con 0x7fb2280b5450 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.676+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2281f1a80 con 0x7fb2280b5450 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.677+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2280cd3e0 con 0x7fb2280b5450 2024-04-25T13:16:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.677+0000 7fb226ffd640 1 -- 172.21.15.26:0/3153135405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb21c01a070 con 0x7fb2280b5450 2024-04-25T13:16:59.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.677+0000 7fb226ffd640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb21406c8f0 0x7fb21406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.678+0000 7fb226ffd640 1 -- 172.21.15.26:0/3153135405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb21c08bd50 con 0x7fb2280b5450 2024-04-25T13:16:59.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.678+0000 7fb22e0d2640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb21406c8f0 0x7fb21406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.678+0000 7fb22e0d2640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb21406c8f0 0x7fb21406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb220034000 tx=0x7fb22002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.682+0000 7fb226ffd640 1 -- 172.21.15.26:0/3153135405 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb21c08f030 con 0x7fb2280b5450 2024-04-25T13:16:59.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.868+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb228068e20 con 0x7fb2280b5450 2024-04-25T13:16:59.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.870+0000 7fb226ffd640 1 -- 172.21.15.26:0/3153135405 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18947 (secure 0 0 0) 0x7fb21c0596f0 con 0x7fb2280b5450 2024-04-25T13:16:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:16:59.870 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:50.350764+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb21406c8f0 msgr2=0x7fb21406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb21406c8f0 0x7fb21406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb220034000 tx=0x7fb22002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2280b5450 msgr2=0x7fb2281e52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2280b5450 0x7fb2281e52c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00e870 tx=0x7fb21c00ed30 comp rx=0 tx=0).stop 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 shutdown_connections 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb21406c8f0 0x7fb21406edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2281554e0 0x7fb22815c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2280b5450 0x7fb2281e52c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 --2- 172.21.15.26:0/3153135405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2280b3c00 0x7fb2281f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 >> 172.21.15.26:0/3153135405 conn(0x7fb228074d50 msgr2=0x7fb2280cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 shutdown_connections 2024-04-25T13:16:59.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.872+0000 7fb230336640 1 -- 172.21.15.26:0/3153135405 wait complete. 2024-04-25T13:16:59.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:07.306201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:08.537870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:12.230813+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:59.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:59.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.987+0000 7fc0a4059640 1 Processor -- start 2024-04-25T13:16:59.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.987+0000 7fc0a4059640 1 -- start start 2024-04-25T13:16:59.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a4059640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc09c155530 0x7fc09c15f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a4059640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc09c0cccf0 0x7fc09c0d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a4059640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a4059640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc09c15bf10 con 0x7fc09c155530 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a4059640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc09c0cbe10 con 0x7fc09c0cccf0 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a4059640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc09c0cc0d0 con 0x7fc09c0d0f00 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc09c155530 0x7fc09c15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc09c155530 0x7fc09c15f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39444/0 (socket says 172.21.15.26:39444) 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 -- 172.21.15.26:0/2735003653 learned_addr learned my addr 172.21.15.26:0/2735003653 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a25f6640 1 --2- 172.21.15.26:0/2735003653 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a15f4640 1 --2- 172.21.15.26:0/2735003653 >> v2:172.21.15.169:3300/0 conn(0x7fc09c0cccf0 0x7fc09c0d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 -- 172.21.15.26:0/2735003653 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 msgr2=0x7fc09c0c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 --2- 172.21.15.26:0/2735003653 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 -- 172.21.15.26:0/2735003653 >> v2:172.21.15.169:3300/0 conn(0x7fc09c0cccf0 msgr2=0x7fc09c0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 --2- 172.21.15.26:0/2735003653 >> v2:172.21.15.169:3300/0 conn(0x7fc09c0cccf0 0x7fc09c0d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.988+0000 7fc0a1df5640 1 -- 172.21.15.26:0/2735003653 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c15b5e0 con 0x7fc09c155530 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.989+0000 7fc0a1df5640 1 --2- 172.21.15.26:0/2735003653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c155530 0x7fc09c15f210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0b4a20 tx=0x7fc09402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c820ba769b9993 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.989+0000 7fc0a0df3640 1 -- 172.21.15.26:0/2735003653 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094037070 con 0x7fc09c155530 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.989+0000 7fc0a0df3640 1 -- 172.21.15.26:0/2735003653 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc094032440 con 0x7fc09c155530 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.989+0000 7fc0a0df3640 1 -- 172.21.15.26:0/2735003653 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094032810 con 0x7fc09c155530 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 -- 172.21.15.26:0/2735003653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c155530 msgr2=0x7fc09c15f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 --2- 172.21.15.26:0/2735003653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c155530 0x7fc09c15f210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0b4a20 tx=0x7fc09402a1e0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 -- 172.21.15.26:0/2735003653 shutdown_connections 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 --2- 172.21.15.26:0/2735003653 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 --2- 172.21.15.26:0/2735003653 >> v2:172.21.15.169:3300/0 conn(0x7fc09c0cccf0 0x7fc09c0d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 --2- 172.21.15.26:0/2735003653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c155530 0x7fc09c15f210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 -- 172.21.15.26:0/2735003653 >> 172.21.15.26:0/2735003653 conn(0x7fc09c06d350 msgr2=0x7fc09c073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 -- 172.21.15.26:0/2735003653 shutdown_connections 2024-04-25T13:16:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.990+0000 7fc0a4059640 1 -- 172.21.15.26:0/2735003653 wait complete. 2024-04-25T13:16:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.991+0000 7fc0a4059640 1 Processor -- start 2024-04-25T13:16:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.991+0000 7fc0a4059640 1 -- start start 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a4059640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c0cccf0 0x7fc09c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a4059640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a4059640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc09c155530 0x7fc09c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a4059640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c15b290 con 0x7fc09c0cccf0 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a4059640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c15bba0 con 0x7fc09c155530 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a4059640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc09c0cba90 con 0x7fc09c0d0f00 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c0cccf0 0x7fc09c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c0cccf0 0x7fc09c157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39454/0 (socket says 172.21.15.26:39454) 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 -- 172.21.15.26:0/1137076550 learned_addr learned my addr 172.21.15.26:0/1137076550 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:16:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a15f4640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a25f6640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc09c155530 0x7fc09c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 -- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 msgr2=0x7fc09c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 -- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc09c155530 msgr2=0x7fc09c157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc09c155530 0x7fc09c157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.992+0000 7fc0a1df5640 1 -- 172.21.15.26:0/1137076550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c0ce0d0 con 0x7fc09c0cccf0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.993+0000 7fc0a1df5640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c0cccf0 0x7fc09c157bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc094000c00 tx=0x7fc0940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.993+0000 7fc0927fc640 1 -- 172.21.15.26:0/1137076550 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094041020 con 0x7fc09c0cccf0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.993+0000 7fc0927fc640 1 -- 172.21.15.26:0/1137076550 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09403d620 con 0x7fc09c0cccf0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.993+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09c0c83b0 con 0x7fc09c0cccf0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.993+0000 7fc0927fc640 1 -- 172.21.15.26:0/1137076550 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094037040 con 0x7fc09c0cccf0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.993+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09c1562a0 con 0x7fc09c0cccf0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.994+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09c069ef0 con 0x7fc09c0cccf0 2024-04-25T13:16:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.994+0000 7fc0927fc640 1 -- 172.21.15.26:0/1137076550 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc094044020 con 0x7fc09c0cccf0 2024-04-25T13:16:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.995+0000 7fc0927fc640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc08006c8f0 0x7fc08006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.995+0000 7fc0927fc640 1 -- 172.21.15.26:0/1137076550 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fc0940ac6e0 con 0x7fc09c0cccf0 2024-04-25T13:16:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.995+0000 7fc0a15f4640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc08006c8f0 0x7fc08006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.995+0000 7fc0a15f4640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc08006c8f0 0x7fc08006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc09c1529d0 tx=0x7fc08c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:16:59.999+0000 7fc0927fc640 1 -- 172.21.15.26:0/1137076550 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc09404b030 con 0x7fc09c0cccf0 2024-04-25T13:17:00.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.183+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc09c0b4040 con 0x7fc09c0cccf0 2024-04-25T13:17:00.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.183+0000 7fc0927fc640 1 -- 172.21.15.26:0/1137076550 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fc09c0b4040 con 0x7fc09c0cccf0 2024-04-25T13:17:00.183 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:17:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc08006c8f0 msgr2=0x7fc08006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc08006c8f0 0x7fc08006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc09c1529d0 tx=0x7fc08c009190 comp rx=0 tx=0).stop 2024-04-25T13:17:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c0cccf0 msgr2=0x7fc09c157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c0cccf0 0x7fc09c157bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc094000c00 tx=0x7fc0940046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 shutdown_connections 2024-04-25T13:17:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc08006c8f0 0x7fc08006edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc09c155530 0x7fc09c157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc09c0d0f00 0x7fc09c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 --2- 172.21.15.26:0/1137076550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc09c0cccf0 0x7fc09c157bb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 >> 172.21.15.26:0/1137076550 conn(0x7fc09c06d350 msgr2=0x7fc09c159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:00.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 shutdown_connections 2024-04-25T13:17:00.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.185+0000 7fc0a4059640 1 -- 172.21.15.26:0/1137076550 wait complete. 2024-04-25T13:17:00.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.299+0000 7f9c3d195640 1 Processor -- start 2024-04-25T13:17:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c3d195640 1 -- start start 2024-04-25T13:17:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c3d195640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c380cc6f0 0x7f9c380cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c3d195640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9c380cbd40 0x7f9c380cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c3d195640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c380d1510 con 0x7f9c381554e0 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c3d195640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9c380cced0 con 0x7f9c380cc6f0 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c3d195640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3815bf00 con 0x7f9c380cbd40 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c2ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c380cc6f0 0x7f9c380cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.300+0000 7f9c2ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c380cc6f0 0x7f9c380cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39456/0 (socket says 172.21.15.26:39456) 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.301+0000 7f9c2ffff640 1 -- 172.21.15.26:0/2046433690 learned_addr learned my addr 172.21.15.26:0/2046433690 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.301+0000 7f9c3759e640 1 --2- 172.21.15.26:0/2046433690 >> v2:172.21.15.169:3300/0 conn(0x7f9c380cbd40 0x7f9c380cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.301+0000 7f9c2ffff640 1 -- 172.21.15.26:0/2046433690 >> v2:172.21.15.169:3300/0 conn(0x7f9c380cbd40 msgr2=0x7f9c380cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.301+0000 7f9c2ffff640 1 --2- 172.21.15.26:0/2046433690 >> v2:172.21.15.169:3300/0 conn(0x7f9c380cbd40 0x7f9c380cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.301+0000 7f9c2ffff640 1 -- 172.21.15.26:0/2046433690 >> v1:172.21.15.169:6789/0 conn(0x7f9c381554e0 legacy=0x7f9c380d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.301+0000 7f9c2ffff640 1 -- 172.21.15.26:0/2046433690 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3815b5d0 con 0x7f9c380cc6f0 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.301+0000 7f9c2ffff640 1 --2- 172.21.15.26:0/2046433690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cc6f0 0x7f9c380cb800 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9c380cc340 tx=0x7f9c2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95423764077e938d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3659c640 1 -- 172.21.15.26:0/2046433690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20037070 con 0x7f9c380cc6f0 2024-04-25T13:17:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3659c640 1 -- 172.21.15.26:0/2046433690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c20032440 con 0x7f9c380cc6f0 2024-04-25T13:17:00.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3659c640 1 -- 172.21.15.26:0/2046433690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20032810 con 0x7f9c380cc6f0 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 -- 172.21.15.26:0/2046433690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cc6f0 msgr2=0x7f9c380cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 --2- 172.21.15.26:0/2046433690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cc6f0 0x7f9c380cb800 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9c380cc340 tx=0x7f9c2002a270 comp rx=0 tx=0).stop 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 -- 172.21.15.26:0/2046433690 shutdown_connections 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 --2- 172.21.15.26:0/2046433690 >> v2:172.21.15.169:3300/0 conn(0x7f9c380cbd40 0x7f9c380cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 --2- 172.21.15.26:0/2046433690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cc6f0 0x7f9c380cb800 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 -- 172.21.15.26:0/2046433690 >> 172.21.15.26:0/2046433690 conn(0x7f9c38074d50 msgr2=0x7f9c38075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 -- 172.21.15.26:0/2046433690 shutdown_connections 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.302+0000 7f9c3d195640 1 -- 172.21.15.26:0/2046433690 wait complete. 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 Processor -- start 2024-04-25T13:17:00.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 -- start start 2024-04-25T13:17:00.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cbd40 0x7f9c381f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c380cc6f0 0x7f9c381f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c381554e0 0x7f9c380cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380d11e0 con 0x7f9c380cbd40 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3815bb90 con 0x7f9c380cc6f0 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c3d195640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3815b280 con 0x7f9c381554e0 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c36d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cbd40 0x7f9c381f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c36d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cbd40 0x7f9c381f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39466/0 (socket says 172.21.15.26:39466) 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.304+0000 7f9c36d9d640 1 -- 172.21.15.26:0/749774412 learned_addr learned my addr 172.21.15.26:0/749774412 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c2ffff640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c380cc6f0 0x7f9c381f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c3759e640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c381554e0 0x7f9c380cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c36d9d640 1 -- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c381554e0 msgr2=0x7f9c380cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c36d9d640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c381554e0 0x7f9c380cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c36d9d640 1 -- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c380cc6f0 msgr2=0x7f9c381f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c36d9d640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c380cc6f0 0x7f9c381f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c36d9d640 1 -- 172.21.15.26:0/749774412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c38158300 con 0x7f9c380cbd40 2024-04-25T13:17:00.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c36d9d640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cbd40 0x7f9c381f5100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c3c0 tx=0x7f9c2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c2f7fe640 1 -- 172.21.15.26:0/749774412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280052d0 con 0x7f9c380cbd40 2024-04-25T13:17:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c2f7fe640 1 -- 172.21.15.26:0/749774412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c28005490 con 0x7f9c380cbd40 2024-04-25T13:17:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c2f7fe640 1 -- 172.21.15.26:0/749774412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28007260 con 0x7f9c380cbd40 2024-04-25T13:17:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c381547e0 con 0x7f9c380cbd40 2024-04-25T13:17:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.305+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c381f4900 con 0x7f9c380cbd40 2024-04-25T13:17:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.306+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c38068e40 con 0x7f9c380cbd40 2024-04-25T13:17:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.307+0000 7f9c2f7fe640 1 -- 172.21.15.26:0/749774412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c28007400 con 0x7f9c380cbd40 2024-04-25T13:17:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.307+0000 7f9c2f7fe640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.307+0000 7f9c2f7fe640 1 -- 172.21.15.26:0/749774412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f9c2808b3e0 con 0x7f9c380cbd40 2024-04-25T13:17:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.307+0000 7f9c2ffff640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.308+0000 7f9c2ffff640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c20034000 tx=0x7f9c2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.312+0000 7f9c2f7fe640 1 -- 172.21.15.26:0/749774412 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c28058d80 con 0x7f9c380cbd40 2024-04-25T13:17:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.498+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9c380741e0 con 0x7f9c380cbd40 2024-04-25T13:17:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.498+0000 7f9c2f7fe640 1 -- 172.21.15.26:0/749774412 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f9c2805d080 con 0x7f9c380cbd40 2024-04-25T13:17:00.498 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:17:00.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9c1806c8f0 msgr2=0x7f9c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c20034000 tx=0x7f9c2002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:00.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cbd40 msgr2=0x7f9c381f5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cbd40 0x7f9c381f5100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c3c0 tx=0x7f9c2800c880 comp rx=0 tx=0).stop 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 shutdown_connections 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c381554e0 0x7f9c380cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c380cc6f0 0x7f9c381f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 --2- 172.21.15.26:0/749774412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c380cbd40 0x7f9c381f5100 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 >> 172.21.15.26:0/749774412 conn(0x7f9c38074d50 msgr2=0x7f9c3815a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 shutdown_connections 2024-04-25T13:17:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.500+0000 7f9c3d195640 1 -- 172.21.15.26:0/749774412 wait complete. 2024-04-25T13:17:00.511 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.615+0000 7ffac89fe640 1 Processor -- start 2024-04-25T13:17:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.615+0000 7ffac89fe640 1 -- start start 2024-04-25T13:17:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac89fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffac4154f00 0x7ffac4073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac89fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffac40cc710 0x7ffac4073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac89fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac415be60 con 0x7ffac40b3600 2024-04-25T13:17:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac89fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ffac415e650 con 0x7ffac40cc710 2024-04-25T13:17:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac89fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ffac415e930 con 0x7ffac4154f00 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffac40cc710 0x7ffac4073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac2d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffac40cc710 0x7ffac4073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39482/0 (socket says 172.21.15.26:39482) 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac2d9d640 1 -- 172.21.15.26:0/1569020421 learned_addr learned my addr 172.21.15.26:0/1569020421 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac259c640 1 --2- 172.21.15.26:0/1569020421 >> v2:172.21.15.169:3300/0 conn(0x7ffac4154f00 0x7ffac4073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac2d9d640 1 -- 172.21.15.26:0/1569020421 >> v2:172.21.15.169:3300/0 conn(0x7ffac4154f00 msgr2=0x7ffac4073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac2d9d640 1 --2- 172.21.15.26:0/1569020421 >> v2:172.21.15.169:3300/0 conn(0x7ffac4154f00 0x7ffac4073110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac2d9d640 1 -- 172.21.15.26:0/1569020421 >> v1:172.21.15.169:6789/0 conn(0x7ffac40b3600 legacy=0x7ffac40cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.616+0000 7ffac2d9d640 1 -- 172.21.15.26:0/1569020421 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac415ec10 con 0x7ffac40cc710 2024-04-25T13:17:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac2d9d640 1 --2- 172.21.15.26:0/1569020421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac40cc710 0x7ffac4073650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffac40cd850 tx=0x7ffabc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c088e3c934250915 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac1d9b640 1 -- 172.21.15.26:0/1569020421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc036070 con 0x7ffac40cc710 2024-04-25T13:17:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac1d9b640 1 -- 172.21.15.26:0/1569020421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc031600 con 0x7ffac40cc710 2024-04-25T13:17:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac1d9b640 1 -- 172.21.15.26:0/1569020421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0319d0 con 0x7ffac40cc710 2024-04-25T13:17:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac89fe640 1 -- 172.21.15.26:0/1569020421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac40cc710 msgr2=0x7ffac4073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac89fe640 1 --2- 172.21.15.26:0/1569020421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac40cc710 0x7ffac4073650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffac40cd850 tx=0x7ffabc02a730 comp rx=0 tx=0).stop 2024-04-25T13:17:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac89fe640 1 -- 172.21.15.26:0/1569020421 shutdown_connections 2024-04-25T13:17:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac89fe640 1 --2- 172.21.15.26:0/1569020421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac40cc710 0x7ffac4073650 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac89fe640 1 --2- 172.21.15.26:0/1569020421 >> v2:172.21.15.169:3300/0 conn(0x7ffac4154f00 0x7ffac4073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.617+0000 7ffac89fe640 1 -- 172.21.15.26:0/1569020421 >> 172.21.15.26:0/1569020421 conn(0x7ffac4068570 msgr2=0x7ffac4071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.618+0000 7ffac89fe640 1 -- 172.21.15.26:0/1569020421 shutdown_connections 2024-04-25T13:17:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.618+0000 7ffac89fe640 1 -- 172.21.15.26:0/1569020421 wait complete. 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.619+0000 7ffac89fe640 1 Processor -- start 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.619+0000 7ffac89fe640 1 -- start start 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40b3600 0x7ffac41f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cc710 0x7ffac4146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac4154f00 0x7ffac4147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffac41552e0 con 0x7ffac4154f00 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffac40cb230 con 0x7ffac40cc710 2024-04-25T13:17:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffac414a910 con 0x7ffac40b3600 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac4154f00 0x7ffac4147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac4154f00 0x7ffac4147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39486/0 (socket says 172.21.15.26:39486) 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 -- 172.21.15.26:0/880635889 learned_addr learned my addr 172.21.15.26:0/880635889 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac259c640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40b3600 0x7ffac41f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffabbfff640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cc710 0x7ffac4146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 -- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40b3600 msgr2=0x7ffac41f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40b3600 0x7ffac41f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 -- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cc710 msgr2=0x7ffac4146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cc710 0x7ffac4146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 -- 172.21.15.26:0/880635889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac415b380 con 0x7ffac4154f00 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac2d9d640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac4154f00 0x7ffac4147330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009f40 tx=0x7ffabc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffabaffd640 1 -- 172.21.15.26:0/880635889 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc036050 con 0x7ffac4154f00 2024-04-25T13:17:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffabaffd640 1 -- 172.21.15.26:0/880635889 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc042070 con 0x7ffac4154f00 2024-04-25T13:17:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac4147f30 con 0x7ffac4154f00 2024-04-25T13:17:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffabaffd640 1 -- 172.21.15.26:0/880635889 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc009510 con 0x7ffac4154f00 2024-04-25T13:17:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.620+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac414ae40 con 0x7ffac4154f00 2024-04-25T13:17:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.621+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac4068f50 con 0x7ffac4154f00 2024-04-25T13:17:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.622+0000 7ffabaffd640 1 -- 172.21.15.26:0/880635889 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffabc007c70 con 0x7ffac4154f00 2024-04-25T13:17:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.622+0000 7ffabaffd640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.622+0000 7ffabaffd640 1 -- 172.21.15.26:0/880635889 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7ffabc0acc70 con 0x7ffac4154f00 2024-04-25T13:17:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.622+0000 7ffac259c640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.623+0000 7ffac259c640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffaa406c8f0 0x7ffaa406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009aa0 tx=0x7ffab4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.626+0000 7ffabaffd640 1 -- 172.21.15.26:0/880635889 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffabc07a610 con 0x7ffac4154f00 2024-04-25T13:17:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.810+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffac415ada0 con 0x7ffac4154f00 2024-04-25T13:17:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.810+0000 7ffabaffd640 1 -- 172.21.15.26:0/880635889 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7ffabc07e910 con 0x7ffac4154f00 2024-04-25T13:17:00.811 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-25T13:17:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffaa406c8f0 msgr2=0x7ffaa406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffaa406c8f0 0x7ffaa406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009aa0 tx=0x7ffab4009190 comp rx=0 tx=0).stop 2024-04-25T13:17:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac4154f00 msgr2=0x7ffac4147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac4154f00 0x7ffac4147330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009f40 tx=0x7ffabc004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 shutdown_connections 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac4154f00 0x7ffac4147330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cc710 0x7ffac4146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 --2- 172.21.15.26:0/880635889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40b3600 0x7ffac41f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 >> 172.21.15.26:0/880635889 conn(0x7ffac4068570 msgr2=0x7ffac40d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 shutdown_connections 2024-04-25T13:17:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.812+0000 7ffac89fe640 1 -- 172.21.15.26:0/880635889 wait complete. 2024-04-25T13:17:00.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:00.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.926+0000 7f3dff859640 1 Processor -- start 2024-04-25T13:17:00.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.926+0000 7f3dff859640 1 -- start start 2024-04-25T13:17:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dff859640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df80cb270 0x7f3df806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dff859640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3df80c60c0 0x7f3df80c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dff859640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df80c5900 con 0x7f3df8155220 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dff859640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3df815c040 con 0x7f3df80c60c0 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dff859640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3df80ccb70 con 0x7f3df80cb270 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dfddf6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3df80c60c0 0x7f3df80c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dfddf6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3df80c60c0 0x7f3df80c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39488/0 (socket says 172.21.15.26:39488) 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dfcdf4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df80cb270 0x7f3df806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.927+0000 7f3dfddf6640 1 -- 172.21.15.26:0/465356384 learned_addr learned my addr 172.21.15.26:0/465356384 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.928+0000 7f3dfddf6640 1 -- 172.21.15.26:0/465356384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df80cb270 msgr2=0x7f3df806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.928+0000 7f3dfddf6640 1 --2- 172.21.15.26:0/465356384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df80cb270 0x7f3df806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.928+0000 7f3dfddf6640 1 -- 172.21.15.26:0/465356384 >> v1:172.21.15.169:6789/0 conn(0x7f3df8155220 legacy=0x7f3df80d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.928+0000 7f3df7fff640 1 -- 172.21.15.26:0/465356384 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732588761 0 0) 0x7f3df80c5900 con 0x7f3df8155220 2024-04-25T13:17:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.928+0000 7f3dfddf6640 1 -- 172.21.15.26:0/465356384 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df80cc4f0 con 0x7f3df80c60c0 2024-04-25T13:17:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.928+0000 7f3dfddf6640 1 --2- 172.21.15.26:0/465356384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80c60c0 0x7f3df80c6550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e50 tx=0x7f3de802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eae3d1927a32e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.928+0000 7f3df7fff640 1 -- 172.21.15.26:0/465356384 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8036070 con 0x7f3df80c60c0 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3df7fff640 1 -- 172.21.15.26:0/465356384 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de8031600 con 0x7f3df80c60c0 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3df7fff640 1 -- 172.21.15.26:0/465356384 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de80319d0 con 0x7f3df80c60c0 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 -- 172.21.15.26:0/465356384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80c60c0 msgr2=0x7f3df80c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 --2- 172.21.15.26:0/465356384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80c60c0 0x7f3df80c6550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e50 tx=0x7f3de802a7a0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 -- 172.21.15.26:0/465356384 shutdown_connections 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 --2- 172.21.15.26:0/465356384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80c60c0 0x7f3df80c6550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 --2- 172.21.15.26:0/465356384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df80cb270 0x7f3df806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 -- 172.21.15.26:0/465356384 >> 172.21.15.26:0/465356384 conn(0x7f3df8075170 msgr2=0x7f3df8075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 -- 172.21.15.26:0/465356384 shutdown_connections 2024-04-25T13:17:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.929+0000 7f3dff859640 1 -- 172.21.15.26:0/465356384 wait complete. 2024-04-25T13:17:00.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.930+0000 7f3dff859640 1 Processor -- start 2024-04-25T13:17:00.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.930+0000 7f3dff859640 1 -- start start 2024-04-25T13:17:00.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dff859640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df80c60c0 0x7f3df8156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dff859640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80cb270 0x7f3df81f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dff859640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df8155220 0x7f3df81f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dff859640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3df815bd60 con 0x7f3df80cb270 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dff859640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3df80c5c30 con 0x7f3df80c60c0 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dff859640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3df8155600 con 0x7f3df8155220 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dfcdf4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80cb270 0x7f3df81f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dfcdf4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80cb270 0x7f3df81f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39500/0 (socket says 172.21.15.26:39500) 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dfd5f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df80c60c0 0x7f3df8156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dfcdf4640 1 -- 172.21.15.26:0/4105521413 learned_addr learned my addr 172.21.15.26:0/4105521413 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.931+0000 7f3dfddf6640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df8155220 0x7f3df81f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dfcdf4640 1 -- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df8155220 msgr2=0x7f3df81f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dfcdf4640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df8155220 0x7f3df81f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dfcdf4640 1 -- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df80c60c0 msgr2=0x7f3df8156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dfcdf4640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df80c60c0 0x7f3df8156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dfcdf4640 1 -- 172.21.15.26:0/4105521413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df8157d80 con 0x7f3df80cb270 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dfd5f5640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df80c60c0 0x7f3df8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dfcdf4640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80cb270 0x7f3df81f0c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00e9e0 tx=0x7f3dec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3df5ffb640 1 -- 172.21.15.26:0/4105521413 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec017070 con 0x7f3df80cb270 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3df5ffb640 1 -- 172.21.15.26:0/4105521413 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec00c9d0 con 0x7f3df80cb270 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df814f800 con 0x7f3df80cb270 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3df5ffb640 1 -- 172.21.15.26:0/4105521413 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00cdc0 con 0x7f3df80cb270 2024-04-25T13:17:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.932+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df8158320 con 0x7f3df80cb270 2024-04-25T13:17:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.933+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df8068e40 con 0x7f3df80cb270 2024-04-25T13:17:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.934+0000 7f3df5ffb640 1 -- 172.21.15.26:0/4105521413 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dec01a070 con 0x7f3df80cb270 2024-04-25T13:17:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.934+0000 7f3df5ffb640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3de406c8f0 0x7f3de406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.934+0000 7f3df5ffb640 1 -- 172.21.15.26:0/4105521413 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f3dec08be60 con 0x7f3df80cb270 2024-04-25T13:17:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.934+0000 7f3dfd5f5640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3de406c8f0 0x7f3de406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.935+0000 7f3dfd5f5640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3de406c8f0 0x7f3de406edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3df0000f60 tx=0x7f3df0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:00.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:00.939+0000 7f3df5ffb640 1 -- 172.21.15.26:0/4105521413 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dec059890 con 0x7f3df80cb270 2024-04-25T13:17:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.121+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3df81f09e0 con 0x7f3df80cb270 2024-04-25T13:17:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.122+0000 7f3df5ffb640 1 -- 172.21.15.26:0/4105521413 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f3dec05db90 con 0x7f3df80cb270 2024-04-25T13:17:01.122 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3de406c8f0 msgr2=0x7f3de406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3de406c8f0 0x7f3de406edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3df0000f60 tx=0x7f3df0009040 comp rx=0 tx=0).stop 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80cb270 msgr2=0x7f3df81f0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80cb270 0x7f3df81f0c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00e9e0 tx=0x7f3dec00eea0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 shutdown_connections 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3de406c8f0 0x7f3de406edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3df8155220 0x7f3df81f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3df80cb270 0x7f3df81f0c80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 --2- 172.21.15.26:0/4105521413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df80c60c0 0x7f3df8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 >> 172.21.15.26:0/4105521413 conn(0x7f3df8075170 msgr2=0x7f3df80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 shutdown_connections 2024-04-25T13:17:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.124+0000 7f3dff859640 1 -- 172.21.15.26:0/4105521413 wait complete. 2024-04-25T13:17:01.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:01.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.236+0000 7f2e6d64e640 1 Processor -- start 2024-04-25T13:17:01.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.236+0000 7f2e6d64e640 1 -- start start 2024-04-25T13:17:01.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e6d64e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bf70 0x7f2e6815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e6d64e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2e680c99f0 0x7f2e680c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e6d64e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6815bef0 con 0x7f2e6806bb90 2024-04-25T13:17:01.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e6d64e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6815f510 con 0x7f2e680c99f0 2024-04-25T13:17:01.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e6d64e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6815b650 con 0x7f2e6806bf70 2024-04-25T13:17:01.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bf70 0x7f2e6815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e677fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2e680c99f0 0x7f2e680c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bf70 0x7f2e6815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:36868/0 (socket says 172.21.15.26:36868) 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e677fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2e680c99f0 0x7f2e680c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:49096/0 (socket says 172.21.15.26:49096) 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e5ffff640 1 -- 172.21.15.26:0/2453240487 learned_addr learned my addr 172.21.15.26:0/2453240487 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e66ffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f2e6806bb90 0x7f2e6815ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:34486/0 (socket says 172.21.15.26:34486) 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e5ffff640 1 -- 172.21.15.26:0/2453240487 >> v2:172.21.15.169:3300/0 conn(0x7f2e680c99f0 msgr2=0x7f2e680c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e5ffff640 1 --2- 172.21.15.26:0/2453240487 >> v2:172.21.15.169:3300/0 conn(0x7f2e680c99f0 0x7f2e680c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e5ffff640 1 -- 172.21.15.26:0/2453240487 >> v1:172.21.15.169:6789/0 conn(0x7f2e6806bb90 legacy=0x7f2e6815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e5ffff640 1 -- 172.21.15.26:0/2453240487 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6815b930 con 0x7f2e6806bf70 2024-04-25T13:17:01.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.237+0000 7f2e677fe640 1 --2- 172.21.15.26:0/2453240487 >> v2:172.21.15.169:3300/0 conn(0x7f2e680c99f0 0x7f2e680c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:01.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.238+0000 7f2e5ffff640 1 --2- 172.21.15.26:0/2453240487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bf70 0x7f2e6815af70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009870 tx=0x7f2e5002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651121577b0519b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.238+0000 7f2e667fc640 1 -- 172.21.15.26:0/2453240487 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50037070 con 0x7f2e6806bf70 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.238+0000 7f2e667fc640 1 -- 172.21.15.26:0/2453240487 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5002ae50 con 0x7f2e6806bf70 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.238+0000 7f2e667fc640 1 -- 172.21.15.26:0/2453240487 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50032860 con 0x7f2e6806bf70 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2453240487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bf70 msgr2=0x7f2e6815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2453240487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bf70 0x7f2e6815af70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009870 tx=0x7f2e5002a300 comp rx=0 tx=0).stop 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2453240487 shutdown_connections 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2453240487 >> v2:172.21.15.169:3300/0 conn(0x7f2e680c99f0 0x7f2e680c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2453240487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bf70 0x7f2e6815af70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2453240487 >> 172.21.15.26:0/2453240487 conn(0x7f2e68074d50 msgr2=0x7f2e68075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2453240487 shutdown_connections 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.239+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2453240487 wait complete. 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.240+0000 7f2e6d64e640 1 Processor -- start 2024-04-25T13:17:01.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.240+0000 7f2e6d64e640 1 -- start start 2024-04-25T13:17:01.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bb90 0x7f2e6815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e6806bf70 0x7f2e681e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e680c99f0 0x7f2e6814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6815e8e0 con 0x7f2e680c99f0 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6815e600 con 0x7f2e6806bf70 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2e68074560 con 0x7f2e6806bb90 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e680c99f0 0x7f2e6814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e66ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bb90 0x7f2e6815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e6806bf70 0x7f2e681e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e680c99f0 0x7f2e6814ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39506/0 (socket says 172.21.15.26:39506) 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e66ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bb90 0x7f2e6815a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:36880/0 (socket says 172.21.15.26:36880) 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 -- 172.21.15.26:0/2769989077 learned_addr learned my addr 172.21.15.26:0/2769989077 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 -- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bb90 msgr2=0x7f2e6815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bb90 0x7f2e6815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 -- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e6806bf70 msgr2=0x7f2e681e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e6806bf70 0x7f2e681e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 -- 172.21.15.26:0/2769989077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6815aed0 con 0x7f2e680c99f0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e5ffff640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e6806bf70 0x7f2e681e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e677fe640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e680c99f0 0x7f2e6814ab00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009e60 tx=0x7f2e6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e5f7fe640 1 -- 172.21.15.26:0/2769989077 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e60018030 con 0x7f2e680c99f0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e5f7fe640 1 -- 172.21.15.26:0/2769989077 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6000cdf0 con 0x7f2e680c99f0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6815b190 con 0x7f2e680c99f0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e5f7fe640 1 -- 172.21.15.26:0/2769989077 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e60003bb0 con 0x7f2e680c99f0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.241+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e681f0ec0 con 0x7f2e680c99f0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.242+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e68068e40 con 0x7f2e680c99f0 2024-04-25T13:17:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.243+0000 7f2e5f7fe640 1 -- 172.21.15.26:0/2769989077 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e6001b070 con 0x7f2e680c99f0 2024-04-25T13:17:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.243+0000 7f2e5f7fe640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2e4806c920 0x7f2e4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.243+0000 7f2e5f7fe640 1 -- 172.21.15.26:0/2769989077 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f2e6008c760 con 0x7f2e680c99f0 2024-04-25T13:17:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.243+0000 7f2e66ffd640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2e4806c920 0x7f2e4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.244+0000 7f2e66ffd640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2e4806c920 0x7f2e4806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007fd0 tx=0x7f2e58007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.248+0000 7f2e5f7fe640 1 -- 172.21.15.26:0/2769989077 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e60010040 con 0x7f2e680c99f0 2024-04-25T13:17:01.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.472+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e680712a0 con 0x7f2e680c99f0 2024-04-25T13:17:01.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.473+0000 7f2e5f7fe640 1 -- 172.21.15.26:0/2769989077 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f2e6005a100 con 0x7f2e680c99f0 2024-04-25T13:17:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:57.377490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4308,"mds_1":4305,"mds_2":4284,"mds_3":4279,"mds_4":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308,4284,4305,4279]},"id":1}]} 2024-04-25T13:17:01.473 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2e4806c920 msgr2=0x7f2e4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2e4806c920 0x7f2e4806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007fd0 tx=0x7f2e58007e80 comp rx=0 tx=0).stop 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e680c99f0 msgr2=0x7f2e6814ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e680c99f0 0x7f2e6814ab00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009e60 tx=0x7f2e6000c490 comp rx=0 tx=0).stop 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 shutdown_connections 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2e4806c920 0x7f2e4806ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e680c99f0 0x7f2e6814ab00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e6806bf70 0x7f2e681e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 --2- 172.21.15.26:0/2769989077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e6806bb90 0x7f2e6815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 >> 172.21.15.26:0/2769989077 conn(0x7f2e68074d50 msgr2=0x7f2e68154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 shutdown_connections 2024-04-25T13:17:01.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.475+0000 7f2e6d64e640 1 -- 172.21.15.26:0/2769989077 wait complete. 2024-04-25T13:17:01.486 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.586+0000 7f09231ef640 1 Processor -- start 2024-04-25T13:17:01.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.586+0000 7f09231ef640 1 -- start start 2024-04-25T13:17:01.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f09231ef640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f091c0c8d20 0x7f091c0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f09231ef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c0cde30 0x7f091c0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f09231ef640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091c0ca090 con 0x7f091c1530a0 2024-04-25T13:17:01.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f09231ef640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f091c0ca330 con 0x7f091c0c8d20 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f09231ef640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f091c0ca610 con 0x7f091c0cde30 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f0920f8b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f091c1530a0 0x7f091c0c4a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36060/0 (socket says 172.21.15.26:36060) 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f0920f8b640 1 -- 172.21.15.26:0/1060808949 learned_addr learned my addr 172.21.15.26:0/1060808949 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f092178c640 1 --2- 172.21.15.26:0/1060808949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c0cde30 0x7f091c0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.587+0000 7f091bfff640 1 --2- 172.21.15.26:0/1060808949 >> v2:172.21.15.169:3300/0 conn(0x7f091c0c8d20 0x7f091c0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.588+0000 7f091b7fe640 1 -- 172.21.15.26:0/1060808949 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263239317 0 0) 0x7f091c0ca090 con 0x7f091c1530a0 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.588+0000 7f091b7fe640 1 -- 172.21.15.26:0/1060808949 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f090c003520 con 0x7f091c1530a0 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.588+0000 7f092178c640 1 -- 172.21.15.26:0/1060808949 >> v2:172.21.15.169:3300/0 conn(0x7f091c0c8d20 msgr2=0x7f091c0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.588+0000 7f092178c640 1 --2- 172.21.15.26:0/1060808949 >> v2:172.21.15.169:3300/0 conn(0x7f091c0c8d20 0x7f091c0cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.588+0000 7f092178c640 1 -- 172.21.15.26:0/1060808949 >> v1:172.21.15.26:6789/0 conn(0x7f091c1530a0 legacy=0x7f091c0c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.588+0000 7f092178c640 1 -- 172.21.15.26:0/1060808949 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c0ca8f0 con 0x7f091c0cde30 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.588+0000 7f091bfff640 1 --2- 172.21.15.26:0/1060808949 >> v2:172.21.15.169:3300/0 conn(0x7f091c0c8d20 0x7f091c0cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f092178c640 1 --2- 172.21.15.26:0/1060808949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c0cde30 0x7f091c0c6f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0914009d90 tx=0x7f091402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba007223fe9c9ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f091b7fe640 1 -- 172.21.15.26:0/1060808949 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914007740 con 0x7f091c0cde30 2024-04-25T13:17:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f091b7fe640 1 -- 172.21.15.26:0/1060808949 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09140078e0 con 0x7f091c0cde30 2024-04-25T13:17:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f091b7fe640 1 -- 172.21.15.26:0/1060808949 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914007c90 con 0x7f091c0cde30 2024-04-25T13:17:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 -- 172.21.15.26:0/1060808949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c0cde30 msgr2=0x7f091c0c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 --2- 172.21.15.26:0/1060808949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c0cde30 0x7f091c0c6f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0914009d90 tx=0x7f091402a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 -- 172.21.15.26:0/1060808949 shutdown_connections 2024-04-25T13:17:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 --2- 172.21.15.26:0/1060808949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c0cde30 0x7f091c0c6f50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 --2- 172.21.15.26:0/1060808949 >> v2:172.21.15.169:3300/0 conn(0x7f091c0c8d20 0x7f091c0cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 -- 172.21.15.26:0/1060808949 >> 172.21.15.26:0/1060808949 conn(0x7f091c06b920 msgr2=0x7f091c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 -- 172.21.15.26:0/1060808949 shutdown_connections 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.589+0000 7f09231ef640 1 -- 172.21.15.26:0/1060808949 wait complete. 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.590+0000 7f09231ef640 1 Processor -- start 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f09231ef640 1 -- start start 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f09231ef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091c0c8d20 0x7f091c142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f09231ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f091c0cde30 0x7f091c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f09231ef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c1530a0 0x7f091c157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f09231ef640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f091c0c5170 con 0x7f091c0c8d20 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f09231ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f091c0c9140 con 0x7f091c0cde30 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f09231ef640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f091c0c54f0 con 0x7f091c1530a0 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f0920f8b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091c0c8d20 0x7f091c142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f0920f8b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091c0c8d20 0x7f091c142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39516/0 (socket says 172.21.15.26:39516) 2024-04-25T13:17:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.591+0000 7f0920f8b640 1 -- 172.21.15.26:0/1972448613 learned_addr learned my addr 172.21.15.26:0/1972448613 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f091bfff640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f091c0cde30 0x7f091c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f092178c640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c1530a0 0x7f091c157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f0920f8b640 1 -- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c1530a0 msgr2=0x7f091c157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f0920f8b640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c1530a0 0x7f091c157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f0920f8b640 1 -- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f091c0cde30 msgr2=0x7f091c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f0920f8b640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f091c0cde30 0x7f091c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f0920f8b640 1 -- 172.21.15.26:0/1972448613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c0cc220 con 0x7f091c0c8d20 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f0920f8b640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091c0c8d20 0x7f091c142da0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f091000c3c0 tx=0x7f091000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f09197fa640 1 -- 172.21.15.26:0/1972448613 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910017070 con 0x7f091c0c8d20 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f09197fa640 1 -- 172.21.15.26:0/1972448613 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0910005ce0 con 0x7f091c0c8d20 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f091c1554f0 con 0x7f091c0c8d20 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f09197fa640 1 -- 172.21.15.26:0/1972448613 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09100072f0 con 0x7f091c0c8d20 2024-04-25T13:17:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.592+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091c155ab0 con 0x7f091c0c8d20 2024-04-25T13:17:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.593+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091c068e40 con 0x7f091c0c8d20 2024-04-25T13:17:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.594+0000 7f09197fa640 1 -- 172.21.15.26:0/1972448613 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f091001a070 con 0x7f091c0c8d20 2024-04-25T13:17:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.594+0000 7f09197fa640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f090006c8f0 0x7f090006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.594+0000 7f09197fa640 1 -- 172.21.15.26:0/1972448613 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f091008b2b0 con 0x7f091c0c8d20 2024-04-25T13:17:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.594+0000 7f091bfff640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f090006c8f0 0x7f090006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.595+0000 7f091bfff640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f090006c8f0 0x7f090006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0908009560 tx=0x7f0908009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.598+0000 7f09197fa640 1 -- 172.21.15.26:0/1972448613 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0910058c50 con 0x7f091c0c8d20 2024-04-25T13:17:01.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.788+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f091c0c5d70 con 0x7f091c0c8d20 2024-04-25T13:17:01.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.790+0000 7f09197fa640 1 -- 172.21.15.26:0/1972448613 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18947 (secure 0 0 0) 0x7f091005cf50 con 0x7f091c0c8d20 2024-04-25T13:17:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:01.790 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:50.350764+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.791+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f090006c8f0 msgr2=0x7f090006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.791+0000 7f09231ef640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f090006c8f0 0x7f090006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0908009560 tx=0x7f0908009190 comp rx=0 tx=0).stop 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.791+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091c0c8d20 msgr2=0x7f091c142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.791+0000 7f09231ef640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091c0c8d20 0x7f091c142da0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f091000c3c0 tx=0x7f091000c880 comp rx=0 tx=0).stop 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 shutdown_connections 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f090006c8f0 0x7f090006edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f091c1530a0 0x7f091c157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f091c0cde30 0x7f091c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 --2- 172.21.15.26:0/1972448613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091c0c8d20 0x7f091c142da0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 >> 172.21.15.26:0/1972448613 conn(0x7f091c06b920 msgr2=0x7f091c145210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 shutdown_connections 2024-04-25T13:17:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.792+0000 7f09231ef640 1 -- 172.21.15.26:0/1972448613 wait complete. 2024-04-25T13:17:01.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.904+0000 7f6bfbc23640 1 Processor -- start 2024-04-25T13:17:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.904+0000 7f6bfbc23640 1 -- start start 2024-04-25T13:17:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bfbc23640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b3c00 0x7f6bf40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bfbc23640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf41558c0 con 0x7f6bf40b5450 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bfbc23640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf40cb8c0 con 0x7f6bf41554e0 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bfbc23640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf40b4a80 con 0x7f6bf40b3c00 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bfa1c0640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6bf40b5450 0x7f6bf40d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36062/0 (socket says 172.21.15.26:36062) 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bfa1c0640 1 -- 172.21.15.26:0/4206034242 learned_addr learned my addr 172.21.15.26:0/4206034242 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf91be640 1 --2- 172.21.15.26:0/4206034242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b3c00 0x7f6bf40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf89bd640 1 -- 172.21.15.26:0/4206034242 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866699703 0 0) 0x7f6bec001490 con 0x7f6bf40b5450 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf89bd640 1 -- 172.21.15.26:0/4206034242 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be0003520 con 0x7f6bf40b5450 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf89bd640 1 -- 172.21.15.26:0/4206034242 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641183794 0 0) 0x7f6bf40cb8c0 con 0x7f6bf41554e0 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf89bd640 1 -- 172.21.15.26:0/4206034242 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bec001490 con 0x7f6bf41554e0 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf91be640 1 -- 172.21.15.26:0/4206034242 >> v1:172.21.15.169:6789/0 conn(0x7f6bf41554e0 legacy=0x7f6bf415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf91be640 1 -- 172.21.15.26:0/4206034242 >> v1:172.21.15.26:6789/0 conn(0x7f6bf40b5450 legacy=0x7f6bf40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.905+0000 7f6bf91be640 1 -- 172.21.15.26:0/4206034242 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40cbba0 con 0x7f6bf40b3c00 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.906+0000 7f6bf91be640 1 --2- 172.21.15.26:0/4206034242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b3c00 0x7f6bf40b4f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097d0 tx=0x7f6be802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2800279ba6ef49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.906+0000 7f6bf89bd640 1 -- 172.21.15.26:0/4206034242 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8037070 con 0x7f6bf40b3c00 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.906+0000 7f6bf89bd640 1 -- 172.21.15.26:0/4206034242 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be8032440 con 0x7f6bf40b3c00 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.906+0000 7f6bf89bd640 1 -- 172.21.15.26:0/4206034242 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be80327f0 con 0x7f6bf40b3c00 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.907+0000 7f6bfbc23640 1 -- 172.21.15.26:0/4206034242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b3c00 msgr2=0x7f6bf40b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.907+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/4206034242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b3c00 0x7f6bf40b4f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097d0 tx=0x7f6be802a290 comp rx=0 tx=0).stop 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.907+0000 7f6bfbc23640 1 -- 172.21.15.26:0/4206034242 shutdown_connections 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.907+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/4206034242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b3c00 0x7f6bf40b4f10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.907+0000 7f6bfbc23640 1 -- 172.21.15.26:0/4206034242 >> 172.21.15.26:0/4206034242 conn(0x7f6bf4074d50 msgr2=0x7f6bf4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.907+0000 7f6bfbc23640 1 -- 172.21.15.26:0/4206034242 shutdown_connections 2024-04-25T13:17:01.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.907+0000 7f6bfbc23640 1 -- 172.21.15.26:0/4206034242 wait complete. 2024-04-25T13:17:01.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.908+0000 7f6bfbc23640 1 Processor -- start 2024-04-25T13:17:01.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.908+0000 7f6bfbc23640 1 -- start start 2024-04-25T13:17:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfbc23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bf40b3c00 0x7f6bf41f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfbc23640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b5450 0x7f6bf41f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfbc23640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf41554e0 0x7f6bf4156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfbc23640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40b4710 con 0x7f6bf41554e0 2024-04-25T13:17:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfbc23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40b4430 con 0x7f6bf40b3c00 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfbc23640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf40b3580 con 0x7f6bf40b5450 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfa1c0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf41554e0 0x7f6bf4156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf99bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bf40b3c00 0x7f6bf41f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b5450 0x7f6bf41f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf99bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bf40b3c00 0x7f6bf41f0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:49130/0 (socket says 172.21.15.26:49130) 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b5450 0x7f6bf41f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:36920/0 (socket says 172.21.15.26:36920) 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf99bf640 1 -- 172.21.15.26:0/1073886137 learned_addr learned my addr 172.21.15.26:0/1073886137 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfa1c0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf41554e0 0x7f6bf4156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39524/0 (socket says 172.21.15.26:39524) 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 -- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bf40b3c00 msgr2=0x7f6bf41f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bf40b3c00 0x7f6bf41f0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 -- 172.21.15.26:0/1073886137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf41554e0 msgr2=0x7f6bf4156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf41554e0 0x7f6bf4156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 -- 172.21.15.26:0/1073886137 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40c8d30 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bfa1c0640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf41554e0 0x7f6bf4156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf99bf640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bf40b3c00 0x7f6bf41f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.909+0000 7f6bf91be640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b5450 0x7f6bf41f4c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6be8031000 tx=0x7f6be80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.910+0000 7f6be67fc640 1 -- 172.21.15.26:0/1073886137 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8041030 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.910+0000 7f6be67fc640 1 -- 172.21.15.26:0/1073886137 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be803d420 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.910+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf40ca330 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.910+0000 7f6be67fc640 1 -- 172.21.15.26:0/1073886137 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8037040 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.910+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf41f4470 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.911+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf4068e40 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.911+0000 7f6be67fc640 1 -- 172.21.15.26:0/1073886137 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6be8044070 con 0x7f6bf40b5450 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.912+0000 7f6be67fc640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6bd806c8f0 0x7f6bd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.912+0000 7f6be67fc640 1 -- 172.21.15.26:0/1073886137 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f6be80ac410 con 0x7f6bf40b5450 2024-04-25T13:17:01.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.912+0000 7f6bf99bf640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6bd806c8f0 0x7f6bd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.912+0000 7f6bf99bf640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6bd806c8f0 0x7f6bd806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0007fd0 tx=0x7f6bf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:01.916+0000 7f6be67fc640 1 -- 172.21.15.26:0/1073886137 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6bf40c8d30 con 0x7f6bf40b5450 2024-04-25T13:17:02.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.143+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bf40c7000 con 0x7f6bf40b5450 2024-04-25T13:17:02.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.144+0000 7f6be67fc640 1 -- 172.21.15.26:0/1073886137 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f6be8079e40 con 0x7f6bf40b5450 2024-04-25T13:17:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:02.144 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:16:57.377490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4308,"mds_1":4305,"mds_2":4284,"mds_3":4279,"mds_4":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308,4284,4305,4279]},"id":1}]} 2024-04-25T13:17:02.144 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2024-04-25T13:17:02.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6bd806c8f0 msgr2=0x7f6bd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6bd806c8f0 0x7f6bd806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0007fd0 tx=0x7f6bf0009040 comp rx=0 tx=0).stop 2024-04-25T13:17:02.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b5450 msgr2=0x7f6bf41f4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b5450 0x7f6bf41f4c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6be8031000 tx=0x7f6be80046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 shutdown_connections 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f6bd806c8f0 0x7f6bd806edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf41554e0 0x7f6bf4156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bf40b5450 0x7f6bf41f4c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 --2- 172.21.15.26:0/1073886137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bf40b3c00 0x7f6bf41f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 >> 172.21.15.26:0/1073886137 conn(0x7f6bf4074d50 msgr2=0x7f6bf40cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 shutdown_connections 2024-04-25T13:17:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:02.146+0000 7f6bfbc23640 1 -- 172.21.15.26:0/1073886137 wait complete. 2024-04-25T13:17:02.761 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:09.585455+0000', 'modified': '2024-04-25T13:16:57.377490+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4308, 'mds_1': 4305, 'mds_2': 4284, 'mds_3': 4279, 'mds_4': 4250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4250': {'gid': 4250, 'name': 'b', 'rank': 4, 'incarnation': 18, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.169:6838/2640767369', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6835', 'nonce': 2640767369}, {'type': 'v1', 'addr': '172.21.15.169:6838', 'nonce': 2640767369}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4279': {'gid': 4279, 'name': 'e', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.26:6837/189019616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6836', 'nonce': 189019616}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 189019616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.26:6834/4286679763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6832', 'nonce': 4286679763}, {'type': 'v1', 'addr': '172.21.15.26:6834', 'nonce': 4286679763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4305': {'gid': 4305, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.169:6837/1123161909', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 1123161909}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 1123161909}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4308': {'gid': 4308, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.169:6839/963417679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 963417679}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 963417679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4308, 'qdb_cluster': [4308, 4284, 4305, 4279]} 2024-04-25T13:17:02.761 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4250:up:creating 2024-04-25T13:17:03.746 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-25T13:17:03.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-25T13:17:03.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.875+0000 7fc52fb76640 1 Processor -- start 2024-04-25T13:17:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.876+0000 7fc52fb76640 1 -- start start 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52fb76640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc5280d08a0 0x7fc5280d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52fb76640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5281558c0 con 0x7fc5281554e0 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52fb76640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5280cb8c0 con 0x7fc5280b3c00 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52fb76640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc5280b4a80 con 0x7fc5280d08a0 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52d912640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc5281554e0 0x7fc52815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46558/0 (socket says 172.21.15.26:46558) 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52d912640 1 -- 172.21.15.26:0/3611660345 learned_addr learned my addr 172.21.15.26:0/3611660345 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52e113640 1 --2- 172.21.15.26:0/3611660345 >> v2:172.21.15.169:3300/0 conn(0x7fc5280d08a0 0x7fc5280d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52c910640 1 -- 172.21.15.26:0/3611660345 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648032911 0 0) 0x7fc524001110 con 0x7fc5281554e0 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52c910640 1 -- 172.21.15.26:0/3611660345 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc514003520 con 0x7fc5281554e0 2024-04-25T13:17:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52c910640 1 -- 172.21.15.26:0/3611660345 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4164045141 0 0) 0x7fc5280cb8c0 con 0x7fc5280b3c00 2024-04-25T13:17:03.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52c910640 1 -- 172.21.15.26:0/3611660345 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc524001110 con 0x7fc5280b3c00 2024-04-25T13:17:03.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52e113640 1 -- 172.21.15.26:0/3611660345 >> v1:172.21.15.169:6789/0 conn(0x7fc5280b3c00 legacy=0x7fc5280b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52e113640 1 -- 172.21.15.26:0/3611660345 >> v1:172.21.15.26:6789/0 conn(0x7fc5281554e0 legacy=0x7fc52815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.877+0000 7fc52e113640 1 -- 172.21.15.26:0/3611660345 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5280cbba0 con 0x7fc5280d08a0 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.878+0000 7fc52e113640 1 --2- 172.21.15.26:0/3611660345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc5280d0cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc520009d90 tx=0x7fc52002a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=525b106c67bb9ff0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.878+0000 7fc52c910640 1 -- 172.21.15.26:0/3611660345 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520037070 con 0x7fc5280d08a0 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.878+0000 7fc52c910640 1 -- 172.21.15.26:0/3611660345 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc520007740 con 0x7fc5280d08a0 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.878+0000 7fc52c910640 1 -- 172.21.15.26:0/3611660345 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520007b10 con 0x7fc5280d08a0 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.879+0000 7fc52fb76640 1 -- 172.21.15.26:0/3611660345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 msgr2=0x7fc5280d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.879+0000 7fc52fb76640 1 --2- 172.21.15.26:0/3611660345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc5280d0cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc520009d90 tx=0x7fc52002a780 comp rx=0 tx=0).stop 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.879+0000 7fc52fb76640 1 -- 172.21.15.26:0/3611660345 shutdown_connections 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.879+0000 7fc52fb76640 1 --2- 172.21.15.26:0/3611660345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc5280d0cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.879+0000 7fc52fb76640 1 -- 172.21.15.26:0/3611660345 >> 172.21.15.26:0/3611660345 conn(0x7fc528074d50 msgr2=0x7fc528075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.879+0000 7fc52fb76640 1 -- 172.21.15.26:0/3611660345 shutdown_connections 2024-04-25T13:17:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.879+0000 7fc52fb76640 1 -- 172.21.15.26:0/3611660345 wait complete. 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.880+0000 7fc52fb76640 1 Processor -- start 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.880+0000 7fc52fb76640 1 -- start start 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52fb76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5280b3c00 0x7fc5280ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52fb76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc528155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52fb76640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5281554e0 0x7fc528156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52fb76640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc5280b4710 con 0x7fc5280b3c00 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52fb76640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5280b4430 con 0x7fc5280d08a0 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52fb76640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc5280b3580 con 0x7fc5281554e0 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5280b3c00 0x7fc5280ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5280b3c00 0x7fc5280ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41696/0 (socket says 172.21.15.26:41696) 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 -- 172.21.15.26:0/759162558 learned_addr learned my addr 172.21.15.26:0/759162558 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d111640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc528155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52e113640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5281554e0 0x7fc528156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 -- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5281554e0 msgr2=0x7fc528156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5281554e0 0x7fc528156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 -- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 msgr2=0x7fc528155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc528155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 -- 172.21.15.26:0/759162558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5281f0e60 con 0x7fc5280b3c00 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d111640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc528155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc52d912640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5280b3c00 0x7fc5280ca320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c6b0 tx=0x7fc52400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.881+0000 7fc51e7fc640 1 -- 172.21.15.26:0/759162558 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524017070 con 0x7fc5280b3c00 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.882+0000 7fc51e7fc640 1 -- 172.21.15.26:0/759162558 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc524005af0 con 0x7fc5280b3c00 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.882+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5281f1140 con 0x7fc5280b3c00 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.882+0000 7fc51e7fc640 1 -- 172.21.15.26:0/759162558 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524007070 con 0x7fc5280b3c00 2024-04-25T13:17:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.882+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5281f1700 con 0x7fc5280b3c00 2024-04-25T13:17:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.882+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc528068e40 con 0x7fc5280b3c00 2024-04-25T13:17:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.883+0000 7fc51e7fc640 1 -- 172.21.15.26:0/759162558 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc52401a070 con 0x7fc5280b3c00 2024-04-25T13:17:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.884+0000 7fc51e7fc640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc50c06c8f0 0x7fc50c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.884+0000 7fc51e7fc640 1 -- 172.21.15.26:0/759162558 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fc52408b570 con 0x7fc5280b3c00 2024-04-25T13:17:03.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.884+0000 7fc52d111640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc50c06c8f0 0x7fc50c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.884+0000 7fc52d111640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc50c06c8f0 0x7fc50c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc518007fd0 tx=0x7fc518009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:03.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:03.888+0000 7fc51e7fc640 1 -- 172.21.15.26:0/759162558 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5281558c0 con 0x7fc5280b3c00 2024-04-25T13:17:04.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.112+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc528155aa0 con 0x7fc5280b3c00 2024-04-25T13:17:04.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.112+0000 7fc51e7fc640 1 -- 172.21.15.26:0/759162558 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7fc524058ea0 con 0x7fc5280b3c00 2024-04-25T13:17:04.112 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:04.113 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:17:03.388937+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4308,"mds_1":4305,"mds_2":4284,"mds_3":4279,"mds_4":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":4,"incarnation":18,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4250,4279,4305,4284,4308]},"id":1}]} 2024-04-25T13:17:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc50c06c8f0 msgr2=0x7fc50c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc50c06c8f0 0x7fc50c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc518007fd0 tx=0x7fc518009040 comp rx=0 tx=0).stop 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5280b3c00 msgr2=0x7fc5280ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5280b3c00 0x7fc5280ca320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c6b0 tx=0x7fc52400cb70 comp rx=0 tx=0).stop 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 shutdown_connections 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fc50c06c8f0 0x7fc50c06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5281554e0 0x7fc528156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5280d08a0 0x7fc528155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 --2- 172.21.15.26:0/759162558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5280b3c00 0x7fc5280ca320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 >> 172.21.15.26:0/759162558 conn(0x7fc528074d50 msgr2=0x7fc5280b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 shutdown_connections 2024-04-25T13:17:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.115+0000 7fc52fb76640 1 -- 172.21.15.26:0/759162558 wait complete. 2024-04-25T13:17:04.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:09.585455+0000', 'modified': '2024-04-25T13:17:03.388937+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4308, 'mds_1': 4305, 'mds_2': 4284, 'mds_3': 4279, 'mds_4': 4250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4250': {'gid': 4250, 'name': 'b', 'rank': 4, 'incarnation': 18, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.169:6838/2640767369', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6835', 'nonce': 2640767369}, {'type': 'v1', 'addr': '172.21.15.169:6838', 'nonce': 2640767369}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4279': {'gid': 4279, 'name': 'e', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.26:6837/189019616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6836', 'nonce': 189019616}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 189019616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.26:6834/4286679763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6832', 'nonce': 4286679763}, {'type': 'v1', 'addr': '172.21.15.26:6834', 'nonce': 4286679763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4305': {'gid': 4305, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.169:6837/1123161909', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 1123161909}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 1123161909}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4308': {'gid': 4308, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.169:6839/963417679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 963417679}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 963417679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4308, 'qdb_cluster': [4250, 4279, 4305, 4284, 4308]} 2024-04-25T13:17:04.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T13:17:04.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:17:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.846+0000 7f1ef8976640 1 Processor -- start 2024-04-25T13:17:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.846+0000 7f1ef8976640 1 -- start start 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.847+0000 7f1ef8976640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1ef415c620 0x7f1ef415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.847+0000 7f1ef8976640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef40c7690 con 0x7f1ef4153130 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.847+0000 7f1ef8976640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef415cfb0 con 0x7f1ef40ca940 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.847+0000 7f1ef8976640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef4159c20 con 0x7f1ef415c620 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.847+0000 7f1ef259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1ef4153130 0x7f1ef4073c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46564/0 (socket says 172.21.15.26:46564) 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.847+0000 7f1ef259c640 1 -- 172.21.15.26:0/3595279700 learned_addr learned my addr 172.21.15.26:0/3595279700 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/3595279700 >> v2:172.21.15.169:3300/0 conn(0x7f1ef415c620 0x7f1ef415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef159a640 1 -- 172.21.15.26:0/3595279700 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911544906 0 0) 0x7f1ef40c7690 con 0x7f1ef4153130 2024-04-25T13:17:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef159a640 1 -- 172.21.15.26:0/3595279700 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ee0003520 con 0x7f1ef4153130 2024-04-25T13:17:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef159a640 1 -- 172.21.15.26:0/3595279700 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868380692 0 0) 0x7f1ef415cfb0 con 0x7f1ef40ca940 2024-04-25T13:17:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef159a640 1 -- 172.21.15.26:0/3595279700 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ef40c7690 con 0x7f1ef40ca940 2024-04-25T13:17:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef2d9d640 1 -- 172.21.15.26:0/3595279700 >> v1:172.21.15.169:6789/0 conn(0x7f1ef40ca940 legacy=0x7f1ef40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef2d9d640 1 -- 172.21.15.26:0/3595279700 >> v1:172.21.15.26:6789/0 conn(0x7f1ef4153130 legacy=0x7f1ef4073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.848+0000 7f1ef2d9d640 1 -- 172.21.15.26:0/3595279700 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef4158d50 con 0x7f1ef415c620 2024-04-25T13:17:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.849+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/3595279700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef415c620 0x7f1ef415ca70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009d90 tx=0x7f1ee402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14416401514f81d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.849+0000 7f1ef159a640 1 -- 172.21.15.26:0/3595279700 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4007740 con 0x7f1ef415c620 2024-04-25T13:17:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.849+0000 7f1ef159a640 1 -- 172.21.15.26:0/3595279700 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee40078e0 con 0x7f1ef415c620 2024-04-25T13:17:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.849+0000 7f1ef159a640 1 -- 172.21.15.26:0/3595279700 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4007cb0 con 0x7f1ef415c620 2024-04-25T13:17:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.849+0000 7f1ef8976640 1 -- 172.21.15.26:0/3595279700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef415c620 msgr2=0x7f1ef415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.849+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3595279700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef415c620 0x7f1ef415ca70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009d90 tx=0x7f1ee402a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.850+0000 7f1ef8976640 1 -- 172.21.15.26:0/3595279700 shutdown_connections 2024-04-25T13:17:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.850+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3595279700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef415c620 0x7f1ef415ca70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.850+0000 7f1ef8976640 1 -- 172.21.15.26:0/3595279700 >> 172.21.15.26:0/3595279700 conn(0x7f1ef4074d50 msgr2=0x7f1ef4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.850+0000 7f1ef8976640 1 -- 172.21.15.26:0/3595279700 shutdown_connections 2024-04-25T13:17:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.850+0000 7f1ef8976640 1 -- 172.21.15.26:0/3595279700 wait complete. 2024-04-25T13:17:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.851+0000 7f1ef8976640 1 Processor -- start 2024-04-25T13:17:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.851+0000 7f1ef8976640 1 -- start start 2024-04-25T13:17:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef8976640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef40ca940 0x7f1ef41e5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef8976640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef4153130 0x7f1ef414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef8976640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ef415c620 0x7f1ef415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef8976640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef41595d0 con 0x7f1ef4153130 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef8976640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef41592f0 con 0x7f1ef40ca940 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef8976640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef41598b0 con 0x7f1ef415c620 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef4153130 0x7f1ef414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef4153130 0x7f1ef414de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41700/0 (socket says 172.21.15.26:41700) 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/3839923798 learned_addr learned my addr 172.21.15.26:0/3839923798 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef40ca940 0x7f1ef41e5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ef415c620 0x7f1ef415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ef415c620 msgr2=0x7f1ef415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ef415c620 0x7f1ef415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef40ca940 msgr2=0x7f1ef41e5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef40ca940 0x7f1ef41e5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/3839923798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef415a610 con 0x7f1ef4153130 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef259c640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef40ca940 0x7f1ef41e5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef4153130 0x7f1ef414de60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c500 tx=0x7f1edc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1eeaffd640 1 -- 172.21.15.26:0/3839923798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0052d0 con 0x7f1ef4153130 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.852+0000 7f1eeaffd640 1 -- 172.21.15.26:0/3839923798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc005490 con 0x7f1ef4153130 2024-04-25T13:17:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.853+0000 7f1eeaffd640 1 -- 172.21.15.26:0/3839923798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc012870 con 0x7f1ef4153130 2024-04-25T13:17:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.853+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef4151a40 con 0x7f1ef4153130 2024-04-25T13:17:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.853+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef41523f0 con 0x7f1ef4153130 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.854+0000 7f1eeaffd640 1 -- 172.21.15.26:0/3839923798 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1edc012a10 con 0x7f1ef4153130 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.855+0000 7f1eeaffd640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1ed406c8f0 0x7f1ed406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.855+0000 7f1eeaffd640 1 -- 172.21.15.26:0/3839923798 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f1edc08bb00 con 0x7f1ef4153130 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.855+0000 7f1ef259c640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1ed406c8f0 0x7f1ed406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.855+0000 7f1ef259c640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1ed406c8f0 0x7f1ed406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000f60 tx=0x7f1eec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.856+0000 7f1efb76d740 1 Processor -- start 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.856+0000 7f1efb76d740 1 -- start start 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc140ca0 0x560efc0fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc101720 0x560efc101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1efb76d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560efc065c50 con 0x560efc101720 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560efc002830 con 0x560efc140ca0 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x560efc061c10 con 0x560efc13c250 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc140ca0 0x560efc0fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef1d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc101720 0x560efc101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef1d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:59960/0 (socket says 172.21.15.26:59960) 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc140ca0 0x560efc0fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:34532/0 (socket says 172.21.15.26:34532) 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/3245678000 learned_addr learned my addr 172.21.15.26:0/3245678000 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef2d9d640 1 -- 172.21.15.26:0/3245678000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 msgr2=0x560efc141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc141080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef2d9d640 1 -- 172.21.15.26:0/3245678000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc140ca0 msgr2=0x560efc0fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc140ca0 0x560efc0fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef2d9d640 1 -- 172.21.15.26:0/3245678000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560efbd782d0 con 0x560efc101720 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef259c640 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc140ca0 0x560efc0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.857+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc101720 0x560efc101ba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40cf1f0 tx=0x7f1ee402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c535f995a3a1f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1ed3fff640 1 -- 172.21.15.26:0/3245678000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4007740 con 0x560efc101720 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1ed3fff640 1 -- 172.21.15.26:0/3245678000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee40078e0 con 0x560efc101720 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1ed3fff640 1 -- 172.21.15.26:0/3245678000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4007c90 con 0x560efc101720 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 -- 172.21.15.26:0/3245678000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc101720 msgr2=0x560efc101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc101720 0x560efc101ba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40cf1f0 tx=0x7f1ee402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 -- 172.21.15.26:0/3245678000 shutdown_connections 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc101720 0x560efc101ba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc141080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 --2- 172.21.15.26:0/3245678000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc140ca0 0x560efc0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 -- 172.21.15.26:0/3245678000 >> 172.21.15.26:0/3245678000 conn(0x560efc0fdc80 msgr2=0x560efc100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 -- 172.21.15.26:0/3245678000 shutdown_connections 2024-04-25T13:17:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.858+0000 7f1efb76d740 1 -- 172.21.15.26:0/3245678000 wait complete. 2024-04-25T13:17:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.859+0000 7f1efb76d740 1 -- start start 2024-04-25T13:17:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.859+0000 7f1efb76d740 1 Processor -- start 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc1213f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc143190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1efb76d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560efc1020e0 con 0x560efc13c250 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560efc000470 con 0x560efc1299d0 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x560efc12b6b0 con 0x560efc140ca0 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1efb76d740 10 client.0 _ll_register_callbacks cb 0x560efc025f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc1213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc1213f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41714/0 (socket says 172.21.15.26:41714) 2024-04-25T13:17:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 -- 172.21.15.26:0/1282587234 learned_addr learned my addr 172.21.15.26:0/1282587234 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 -- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 msgr2=0x560efc143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 -- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 msgr2=0x560efc1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.860+0000 7f1ef259c640 1 -- 172.21.15.26:0/1282587234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560efbe426b0 con 0x560efc13c250 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ef259c640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc1213f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1eec014a60 tx=0x7f1eec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e19a764d4147951 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ed17fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1282587234 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec025020 con 0x560efc13c250 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1282587234 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f1eec013ac0 con 0x560efc13c250 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ee40078e0 con 0x560efc13c250 2024-04-25T13:17:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1282587234 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1eec02f050 con 0x560efc13c250 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 10 client.4968 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560efc157340 con 0x560efc13c250 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1282587234 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee40078e0 con 0x560efc13c250 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1282587234 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f1eec032020 con 0x560efc13c250 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 10 client.4968 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 10 client.4968 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 20 client.4968 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 0x560efc165700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 4 client.4968 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 --> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560efc073670 con 0x560efc11fab0 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.861+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 0x560efc165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.862+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 msgr2=0x560efc165700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.862+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 msgr2=0x560efc165700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.862+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 0x560efc165700 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:17:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:04.862+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 0x560efc165700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:17:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:05.063+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 0x560efc165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:05.063+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 0x560efc165700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c9dd37f78d993398 server_cookie=2dacb5f9950bf8c5 in_seq=0 out_seq=0 2024-04-25T13:17:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:05.063+0000 7f1ed17fa640 10 client.4968 ms_handle_connect on v2:172.21.15.169:6835/2640767369 2024-04-25T13:17:06.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:06.287 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1282587234 <== mds.4 v2:172.21.15.169:6835/2640767369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560efc073670 con 0x560efc11fab0 2024-04-25T13:17:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1ed17fa640 10 client.4968 handle_command_reply: tid=0 2024-04-25T13:17:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 client.4968 shutdown 2024-04-25T13:17:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 msgr2=0x560efc1213f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc1213f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1eec014a60 tx=0x7f1eec0057f0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 shutdown_connections 2024-04-25T13:17:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc11fab0 0x560efc165700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1282587234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc1213f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1ed17fa640 0 client.4968 ms_handle_reset on v2:172.21.15.169:6835/2640767369 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.395+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 >> 172.21.15.26:0/1282587234 conn(0x560efc101720 msgr2=0x560efc141080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.396+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 shutdown_connections 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.396+0000 7f1efb76d740 1 -- 172.21.15.26:0/1282587234 wait complete. 2024-04-25T13:17:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.396+0000 7f1efb76d740 20 client.4968 trim_cache size 0 max 16384 2024-04-25T13:17:08.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 Processor -- start 2024-04-25T13:17:08.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 -- start start 2024-04-25T13:17:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc0f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc0f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc1004c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef406d8a0 con 0x560efc13c250 2024-04-25T13:17:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560efc12a5d0 con 0x560efc1299d0 2024-04-25T13:17:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.416+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x560efc124110 con 0x560efc140ca0 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc0f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc0f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41726/0 (socket says 172.21.15.26:41726) 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1457273453 learned_addr learned my addr 172.21.15.26:0/1457273453 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc1004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef259c640 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc0f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 msgr2=0x560efc1004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc1004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 msgr2=0x560efc0f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc0f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1457273453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560efc13ffd0 con 0x560efc13c250 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc0f73b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c4d0 tx=0x7f1edc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09ef5e4e5ca058e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ed37fe640 1 -- 172.21.15.26:0/1457273453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0772e0 con 0x560efc13c250 2024-04-25T13:17:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ed37fe640 1 -- 172.21.15.26:0/1457273453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc012d00 con 0x560efc13c250 2024-04-25T13:17:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.417+0000 7f1ed37fe640 1 -- 172.21.15.26:0/1457273453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc061b50 con 0x560efc13c250 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 -- 172.21.15.26:0/1457273453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 msgr2=0x560efc0f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc0f73b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c4d0 tx=0x7f1edc000bc0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 -- 172.21.15.26:0/1457273453 shutdown_connections 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc140ca0 0x560efc1004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc13c250 0x560efc0f73b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1457273453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc0f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 -- 172.21.15.26:0/1457273453 >> 172.21.15.26:0/1457273453 conn(0x560efc101720 msgr2=0x560efc0ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 -- 172.21.15.26:0/1457273453 shutdown_connections 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.418+0000 7f1efb76d740 1 -- 172.21.15.26:0/1457273453 wait complete. 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.419+0000 7f1efb76d740 1 -- start start 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.419+0000 7f1efb76d740 1 Processor -- start 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc11ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc1ba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1efb76d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc140ca0 0x560efc1bac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1efb76d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560efc11f930 con 0x560efc140ca0 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560efc15a4c0 con 0x560efc1299d0 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1efb76d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x560efc120000 con 0x560efc13c250 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1efb76d740 10 client.0 _ll_register_callbacks cb 0x7f1eec001760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1ef2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc140ca0 0x560efc1bac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc11ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1ef1d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc1ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1ef2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc140ca0 0x560efc1bac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41738/0 (socket says 172.21.15.26:41738) 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.420+0000 7f1ef2d9d640 1 -- 172.21.15.26:0/1532267474 learned_addr learned my addr 172.21.15.26:0/1532267474 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 msgr2=0x560efc11ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc11ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1532267474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc140ca0 msgr2=0x560efc1bac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc140ca0 0x560efc1bac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef1d9b640 1 -- 172.21.15.26:0/1532267474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x560efc123020 con 0x560efc13c250 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef2d9d640 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc140ca0 0x560efc1bac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef259c640 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc11ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ef1d9b640 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc1ba700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1edc084000 tx=0x7f1edc05c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbac323fddaa643 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ed17fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3301/0 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1532267474 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc055b20 con 0x560efc13c250 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1532267474 <== mon.2 v2:172.21.15.169:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f1edc061b50 con 0x560efc13c250 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1edc012d00 con 0x560efc13c250 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1532267474 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1edc083050 con 0x560efc13c250 2024-04-25T13:17:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1efb76d740 10 client.4652 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.421+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560efc156be0 con 0x560efc13c250 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1532267474 <== mon.2 v2:172.21.15.169:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc012d00 con 0x560efc13c250 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1532267474 <== mon.2 v2:172.21.15.169:3301/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f1edc0831f0 con 0x560efc13c250 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1efb76d740 10 client.4652 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1efb76d740 10 client.4652 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1efb76d740 20 client.4652 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc143fb0 0x560efc144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1efb76d740 4 client.4652 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 --> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] -- command(tid 0: {"prefix": "status"}) -- 0x560efc06d4e0 con 0x560efc143fb0 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1ef259c640 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc143fb0 0x560efc144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1ef259c640 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc143fb0 0x560efc144390 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d890fbcdcac6a22e server_cookie=ea3f226504dd629c in_seq=0 out_seq=0 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.422+0000 7f1ed17fa640 10 client.4652 ms_handle_connect on v2:172.21.15.169:6835/2640767369 2024-04-25T13:17:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1ed17fa640 1 -- 172.21.15.26:0/1532267474 <== mds.4 v2:172.21.15.169:6835/2640767369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560efc06d4e0 con 0x560efc143fb0 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1ed17fa640 10 client.4652 handle_command_reply: tid=0 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 client.4652 shutdown 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 msgr2=0x560efc1ba700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc1ba700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1edc084000 tx=0x7f1edc05c040 comp rx=0 tx=0).stop 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 shutdown_connections 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560efc140ca0 0x560efc1bac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:6835/2640767369,v1:172.21.15.169:6838/2640767369] conn(0x560efc143fb0 0x560efc144390 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560efc13c250 0x560efc1ba700 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1ed17fa640 0 client.4652 ms_handle_reset on v2:172.21.15.169:6835/2640767369 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 --2- 172.21.15.26:0/1532267474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560efc1299d0 0x560efc11ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 >> 172.21.15.26:0/1532267474 conn(0x560efc101720 msgr2=0x560efc1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 shutdown_connections 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 1 -- 172.21.15.26:0/1532267474 wait complete. 2024-04-25T13:17:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.423+0000 7f1efb76d740 20 client.4652 trim_cache size 0 max 16384 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8f4a7b84-1cd1-4957-a762-8e7959ae0a88", 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 4, 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4250, 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 11.043616595, 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-25T13:17:08.428 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T13:17:08.429 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 65.680062574000004 2024-04-25T13:17:08.429 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1ed406c8f0 msgr2=0x7f1ed406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1ed406c8f0 0x7f1ed406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000f60 tx=0x7f1eec009040 comp rx=0 tx=0).stop 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef4153130 msgr2=0x7f1ef414de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef4153130 0x7f1ef414de60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c500 tx=0x7f1edc00c9c0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 shutdown_connections 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1ed406c8f0 0x7f1ed406edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ef415c620 0x7f1ef415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef4153130 0x7f1ef414de60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 --2- 172.21.15.26:0/3839923798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef40ca940 0x7f1ef41e5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 >> 172.21.15.26:0/3839923798 conn(0x7f1ef4074d50 msgr2=0x7f1ef4070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 shutdown_connections 2024-04-25T13:17:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.424+0000 7f1ef8976640 1 -- 172.21.15.26:0/3839923798 wait complete. 2024-04-25T13:17:08.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-25T13:17:08.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.547+0000 7f3b7999b640 1 Processor -- start 2024-04-25T13:17:08.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.547+0000 7f3b7999b640 1 -- start start 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.547+0000 7f3b7999b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b74155550 0x7f3b7415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.547+0000 7f3b7999b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3b740cb9e0 0x7f3b740c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b7999b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b740ccf00 con 0x7f3b74155170 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b7999b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3b740cddf0 con 0x7f3b74155550 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b7999b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7415f430 con 0x7f3b740cb9e0 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b727fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b74155550 0x7f3b7415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b727fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b74155550 0x7f3b7415eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41744/0 (socket says 172.21.15.26:41744) 2024-04-25T13:17:08.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b727fc640 1 -- 172.21.15.26:0/2035815147 learned_addr learned my addr 172.21.15.26:0/2035815147 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b737fe640 1 --2- 172.21.15.26:0/2035815147 >> v2:172.21.15.169:3300/0 conn(0x7f3b740cb9e0 0x7f3b740c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b727fc640 1 -- 172.21.15.26:0/2035815147 >> v2:172.21.15.169:3300/0 conn(0x7f3b740cb9e0 msgr2=0x7f3b740c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b727fc640 1 --2- 172.21.15.26:0/2035815147 >> v2:172.21.15.169:3300/0 conn(0x7f3b740cb9e0 0x7f3b740c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b727fc640 1 -- 172.21.15.26:0/2035815147 >> v1:172.21.15.169:6789/0 conn(0x7f3b74155170 legacy=0x7f3b740d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b727fc640 1 -- 172.21.15.26:0/2035815147 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b740cd1e0 con 0x7f3b74155550 2024-04-25T13:17:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.548+0000 7f3b737fe640 1 --2- 172.21.15.26:0/2035815147 >> v2:172.21.15.169:3300/0 conn(0x7f3b740cb9e0 0x7f3b740c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b727fc640 1 --2- 172.21.15.26:0/2035815147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415eef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009870 tx=0x7f3b6802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79b045c660d61c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b71ffb640 1 -- 172.21.15.26:0/2035815147 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68037070 con 0x7f3b74155550 2024-04-25T13:17:08.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b71ffb640 1 -- 172.21.15.26:0/2035815147 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b68032440 con 0x7f3b74155550 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b71ffb640 1 -- 172.21.15.26:0/2035815147 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68032810 con 0x7f3b74155550 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b7999b640 1 -- 172.21.15.26:0/2035815147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 msgr2=0x7f3b7415eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b7999b640 1 --2- 172.21.15.26:0/2035815147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415eef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009870 tx=0x7f3b6802a2a0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b7999b640 1 -- 172.21.15.26:0/2035815147 shutdown_connections 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b7999b640 1 --2- 172.21.15.26:0/2035815147 >> v2:172.21.15.169:3300/0 conn(0x7f3b740cb9e0 0x7f3b740c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b7999b640 1 --2- 172.21.15.26:0/2035815147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415eef0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.549+0000 7f3b7999b640 1 -- 172.21.15.26:0/2035815147 >> 172.21.15.26:0/2035815147 conn(0x7f3b74072570 msgr2=0x7f3b74074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.550+0000 7f3b7999b640 1 -- 172.21.15.26:0/2035815147 shutdown_connections 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.550+0000 7f3b7999b640 1 -- 172.21.15.26:0/2035815147 wait complete. 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.551+0000 7f3b7999b640 1 Processor -- start 2024-04-25T13:17:08.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.551+0000 7f3b7999b640 1 -- start start 2024-04-25T13:17:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b740cb9e0 0x7f3b74158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74155170 0x7f3b741594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3b740cda80 con 0x7f3b74155550 2024-04-25T13:17:08.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b740cd7a0 con 0x7f3b740cb9e0 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3b740ccae0 con 0x7f3b74155170 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41748/0 (socket says 172.21.15.26:41748) 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 -- 172.21.15.26:0/3842335033 learned_addr learned my addr 172.21.15.26:0/3842335033 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b740cb9e0 0x7f3b74158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b727fc640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74155170 0x7f3b741594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 -- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74155170 msgr2=0x7f3b741594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74155170 0x7f3b741594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 -- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b740cb9e0 msgr2=0x7f3b74158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b740cb9e0 0x7f3b74158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 -- 172.21.15.26:0/3842335033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b741f0cf0 con 0x7f3b74155550 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b740cb9e0 0x7f3b74158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:08.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b727fc640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74155170 0x7f3b741594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b737fe640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415b260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00ef90 tx=0x7f3b6c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b5bfff640 1 -- 172.21.15.26:0/3842335033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c018020 con 0x7f3b74155550 2024-04-25T13:17:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b5bfff640 1 -- 172.21.15.26:0/3842335033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6c014480 con 0x7f3b74155550 2024-04-25T13:17:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b741f0fb0 con 0x7f3b74155550 2024-04-25T13:17:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b5bfff640 1 -- 172.21.15.26:0/3842335033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c014870 con 0x7f3b74155550 2024-04-25T13:17:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.552+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b741f1570 con 0x7f3b74155550 2024-04-25T13:17:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.554+0000 7f3b5bfff640 1 -- 172.21.15.26:0/3842335033 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b6c005d10 con 0x7f3b74155550 2024-04-25T13:17:08.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.554+0000 7f3b5bfff640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3b6006c920 0x7f3b6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.554+0000 7f3b5bfff640 1 -- 172.21.15.26:0/3842335033 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f3b6c08cd50 con 0x7f3b74155550 2024-04-25T13:17:08.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.554+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3b6006c920 0x7f3b6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.555+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3b6006c920 0x7f3b6006ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b64001700 tx=0x7f3b64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.555+0000 7f3b7c793740 1 Processor -- start 2024-04-25T13:17:08.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.555+0000 7f3b7c793740 1 -- start start 2024-04-25T13:17:08.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7690 0x555dccdeba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda6fc0 0x555dccdaaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7a70 0x555dccdf58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b7c793740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555dccd10c50 con 0x555dccda7a70 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555dcccad830 con 0x555dccda7690 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x555dccd0cc10 con 0x555dccda6fc0 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7a70 0x555dccdf58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7a70 0x555dccdf58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41754/0 (socket says 172.21.15.26:41754) 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b727fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda6fc0 0x555dccdaaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b737fe640 1 -- 172.21.15.26:0/1071256026 learned_addr learned my addr 172.21.15.26:0/1071256026 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b72ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7690 0x555dccdeba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b737fe640 1 -- 172.21.15.26:0/1071256026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda6fc0 msgr2=0x555dccdaaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b737fe640 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda6fc0 0x555dccdaaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b737fe640 1 -- 172.21.15.26:0/1071256026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7690 msgr2=0x555dccdeba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.556+0000 7f3b737fe640 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7690 0x555dccdeba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b737fe640 1 -- 172.21.15.26:0/1071256026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dcca232d0 con 0x555dccda7a70 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7690 0x555dccdeba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b737fe640 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7a70 0x555dccdf58a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c08ad80 tx=0x7f3b6c05ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e9ccc8fb625eee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b597fa640 1 -- 172.21.15.26:0/1071256026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c063220 con 0x555dccda7a70 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b597fa640 1 -- 172.21.15.26:0/1071256026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6c058940 con 0x555dccda7a70 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b597fa640 1 -- 172.21.15.26:0/1071256026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c056cb0 con 0x555dccda7a70 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b7c793740 1 -- 172.21.15.26:0/1071256026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7a70 msgr2=0x555dccdf58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b7c793740 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7a70 0x555dccdf58a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c08ad80 tx=0x7f3b6c05ae80 comp rx=0 tx=0).stop 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.557+0000 7f3b7c793740 1 -- 172.21.15.26:0/1071256026 shutdown_connections 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7a70 0x555dccdf58a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda6fc0 0x555dccdaaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 --2- 172.21.15.26:0/1071256026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7690 0x555dccdeba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 -- 172.21.15.26:0/1071256026 >> 172.21.15.26:0/1071256026 conn(0x555dccda8c80 msgr2=0x555dccdab580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 -- 172.21.15.26:0/1071256026 shutdown_connections 2024-04-25T13:17:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 -- 172.21.15.26:0/1071256026 wait complete. 2024-04-25T13:17:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 -- start start 2024-04-25T13:17:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.558+0000 7f3b7c793740 1 Processor -- start 2024-04-25T13:17:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccdd5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdd2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccdc92f0 0x555dccdcb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b7c793740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555dccdec700 con 0x555dccda7690 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555dcccab470 con 0x555dccda7a70 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x555dccdaa0e0 con 0x555dccdc92f0 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b7c793740 10 client.0 _ll_register_callbacks cb 0x555dcccd0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccdd5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccdd5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41756/0 (socket says 172.21.15.26:41756) 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 -- 172.21.15.26:0/789076446 learned_addr learned my addr 172.21.15.26:0/789076446 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b727fc640 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdd2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b737fe640 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccdc92f0 0x555dccdcb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 -- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccdc92f0 msgr2=0x555dccdcb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccdc92f0 0x555dccdcb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 -- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 msgr2=0x555dccdd2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdd2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 -- 172.21.15.26:0/789076446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dccaed6b0 con 0x555dccda7690 2024-04-25T13:17:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccdd5420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400fad0 tx=0x7f3b64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e97b0d05779d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.559+0000 7f3b527fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b527fc640 1 -- 172.21.15.26:0/789076446 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64003d00 con 0x555dccda7690 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b527fc640 1 -- 172.21.15.26:0/789076446 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f3b64010040 con 0x555dccda7690 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b6c058940 con 0x555dccda7690 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b527fc640 1 -- 172.21.15.26:0/789076446 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b6402c050 con 0x555dccda7690 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 10 client.4986 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x555dccdc8630 con 0x555dccda7690 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b527fc640 1 -- 172.21.15.26:0/789076446 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6c058940 con 0x555dccda7690 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b527fc640 1 -- 172.21.15.26:0/789076446 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f3b6402f020 con 0x555dccda7690 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 10 client.4986 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 10 client.4986 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 20 client.4986 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdcc400 0x555dcce0c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 4 client.4986 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 --> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dccd1e670 con 0x555dccdcc400 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.560+0000 7f3b727fc640 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdcc400 0x555dcce0c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b527fc640 10 client.4986 ms_handle_connect on v2:172.21.15.26:6836/189019616 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b727fc640 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdcc400 0x555dcce0c240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d2b257c22a790cb0 server_cookie=5fe469969a10339c in_seq=0 out_seq=0 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b527fc640 1 -- 172.21.15.26:0/789076446 <== mds.3 v2:172.21.15.26:6836/189019616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555dccd1e670 con 0x555dccdcc400 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b527fc640 10 client.4986 handle_command_reply: tid=0 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 client.4986 shutdown 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 msgr2=0x555dccdd5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccdd5420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400fad0 tx=0x7f3b64000ed0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 shutdown_connections 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccdc92f0 0x555dccdcb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdcc400 0x555dcce0c240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdd2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 --2- 172.21.15.26:0/789076446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccdd5420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b527fc640 0 client.4986 ms_handle_reset on v2:172.21.15.26:6836/189019616 2024-04-25T13:17:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.561+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 >> 172.21.15.26:0/789076446 conn(0x555dccda6fc0 msgr2=0x555dccdeaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.562+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 shutdown_connections 2024-04-25T13:17:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.562+0000 7f3b7c793740 1 -- 172.21.15.26:0/789076446 wait complete. 2024-04-25T13:17:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.562+0000 7f3b7c793740 20 client.4986 trim_cache size 0 max 16384 2024-04-25T13:17:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.580+0000 7f3b7c793740 1 Processor -- start 2024-04-25T13:17:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.580+0000 7f3b7c793740 1 -- start start 2024-04-25T13:17:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccda5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7a70 0x555dccda5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccdc92f0 0x555dccded470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b7c793740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74149130 con 0x555dccda7690 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555dccdcd480 con 0x555dccdc92f0 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x555dccdd48c0 con 0x555dccda7a70 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccda5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccda5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41758/0 (socket says 172.21.15.26:41758) 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 -- 172.21.15.26:0/2992459518 learned_addr learned my addr 172.21.15.26:0/2992459518 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b737fe640 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccdc92f0 0x555dccded470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b727fc640 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7a70 0x555dccda5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 -- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7a70 msgr2=0x555dccda5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7a70 0x555dccda5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 -- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccdc92f0 msgr2=0x555dccded470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccdc92f0 0x555dccded470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 -- 172.21.15.26:0/2992459518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dccdd3cc0 con 0x555dccda7690 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b727fc640 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7a70 0x555dccda5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.581+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccda5940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3b640050d0 tx=0x7f3b6401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a323e468864d2df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b58ff9640 1 -- 172.21.15.26:0/2992459518 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400e5b0 con 0x555dccda7690 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b58ff9640 1 -- 172.21.15.26:0/2992459518 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b64003d00 con 0x555dccda7690 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b58ff9640 1 -- 172.21.15.26:0/2992459518 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400e9e0 con 0x555dccda7690 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 -- 172.21.15.26:0/2992459518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 msgr2=0x555dccda5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccda5940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3b640050d0 tx=0x7f3b6401a000 comp rx=0 tx=0).stop 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 -- 172.21.15.26:0/2992459518 shutdown_connections 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccdc92f0 0x555dccded470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7a70 0x555dccda5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 --2- 172.21.15.26:0/2992459518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccda7690 0x555dccda5940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 -- 172.21.15.26:0/2992459518 >> 172.21.15.26:0/2992459518 conn(0x555dccda6fc0 msgr2=0x555dccdab720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 -- 172.21.15.26:0/2992459518 shutdown_connections 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.582+0000 7f3b7c793740 1 -- 172.21.15.26:0/2992459518 wait complete. 2024-04-25T13:17:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.583+0000 7f3b7c793740 1 -- start start 2024-04-25T13:17:08.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.583+0000 7f3b7c793740 1 Processor -- start 2024-04-25T13:17:08.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7690 0x555dccdc2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdc7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccdc92f0 0x555dcce5ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555dccdc6160 con 0x555dccdc92f0 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555dccdcc280 con 0x555dccda7a70 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x555dccdc67f0 con 0x555dccda7690 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 10 client.0 _ll_register_callbacks cb 0x7f3b64001340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccdc92f0 0x555dcce5ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccdc92f0 0x555dcce5ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41766/0 (socket says 172.21.15.26:41766) 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 -- 172.21.15.26:0/3694427578 learned_addr learned my addr 172.21.15.26:0/3694427578 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7690 0x555dccdc2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b727fc640 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdc7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 -- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7690 msgr2=0x555dccdc2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7690 0x555dccdc2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 -- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 msgr2=0x555dccdc7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdc7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 -- 172.21.15.26:0/3694427578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dccdabf00 con 0x555dccdc92f0 2024-04-25T13:17:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b737fe640 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccdc92f0 0x555dcce5ea40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c05a800 tx=0x7f3b6c05d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316662962c0bf754 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b527fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b527fc640 1 -- 172.21.15.26:0/3694427578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c07e060 con 0x555dccdc92f0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b527fc640 1 -- 172.21.15.26:0/3694427578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f3b6c05fb80 con 0x555dccdc92f0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b64003d00 con 0x555dccdc92f0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b527fc640 1 -- 172.21.15.26:0/3694427578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b6c063220 con 0x555dccdc92f0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 10 client.4992 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.584+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x555dccdedbc0 con 0x555dccdc92f0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b527fc640 1 -- 172.21.15.26:0/3694427578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b64003d00 con 0x555dccdc92f0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b527fc640 1 -- 172.21.15.26:0/3694427578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f3b6c059a90 con 0x555dccdc92f0 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 10 client.4992 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 10 client.4992 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 20 client.4992 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdd0d10 0x555dccdd10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 4 client.4992 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 --> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] -- command(tid 0: {"prefix": "status"}) -- 0x555dccd184e0 con 0x555dccdd0d10 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdd0d10 0x555dccdd10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b72ffd640 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdd0d10 0x555dccdd10f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1123d3f449d1b569 server_cookie=e46437e9cd986267 in_seq=0 out_seq=0 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b527fc640 10 client.4992 ms_handle_connect on v2:172.21.15.26:6836/189019616 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b527fc640 1 -- 172.21.15.26:0/3694427578 <== mds.3 v2:172.21.15.26:6836/189019616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555dccd184e0 con 0x555dccdd0d10 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b527fc640 10 client.4992 handle_command_reply: tid=0 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 client.4992 shutdown 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccdc92f0 msgr2=0x555dcce5ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccdc92f0 0x555dcce5ea40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c05a800 tx=0x7f3b6c05d000 comp rx=0 tx=0).stop 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 shutdown_connections 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555dccdc92f0 0x555dcce5ea40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.585+0000 7f3b7c793740 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.26:6836/189019616,v1:172.21.15.26:6837/189019616] conn(0x555dccdd0d10 0x555dccdd10f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7c793740 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555dccda7a70 0x555dccdc7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7c793740 1 --2- 172.21.15.26:0/3694427578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555dccda7690 0x555dccdc2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b527fc640 0 client.4992 ms_handle_reset on v2:172.21.15.26:6836/189019616 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 >> 172.21.15.26:0/3694427578 conn(0x555dccda6fc0 msgr2=0x555dccdbfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 shutdown_connections 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7c793740 1 -- 172.21.15.26:0/3694427578 wait complete. 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7c793740 20 client.4992 trim_cache size 0 max 16384 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8f4a7b84-1cd1-4957-a762-8e7959ae0a88", 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 3, 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4279, 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-25T13:17:08.592 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-25T13:17:08.593 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 17.218239685, 2024-04-25T13:17:08.593 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-25T13:17:08.593 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-25T13:17:08.593 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T13:17:08.593 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 65.854266859000006 2024-04-25T13:17:08.593 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3b6006c920 msgr2=0x7f3b6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3b6006c920 0x7f3b6006ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b64001700 tx=0x7f3b64009040 comp rx=0 tx=0).stop 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 msgr2=0x7f3b7415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415b260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00ef90 tx=0x7f3b6c009f90 comp rx=0 tx=0).stop 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 shutdown_connections 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3b6006c920 0x7f3b6006ede0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b74155550 0x7f3b7415b260 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74155170 0x7f3b741594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 --2- 172.21.15.26:0/3842335033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b740cb9e0 0x7f3b74158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 >> 172.21.15.26:0/3842335033 conn(0x7f3b74072570 msgr2=0x7f3b740cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 shutdown_connections 2024-04-25T13:17:08.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.586+0000 7f3b7999b640 1 -- 172.21.15.26:0/3842335033 wait complete. 2024-04-25T13:17:08.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T13:17:08.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.699+0000 7f585bcae640 1 Processor -- start 2024-04-25T13:17:08.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.699+0000 7f585bcae640 1 -- start start 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f585bcae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58540ca940 0x7f58540ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f585bcae640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58540c7690 con 0x7f5854153130 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f585bcae640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5854158d50 con 0x7f58540ceb40 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f585bcae640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5854159c20 con 0x7f58540ca940 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5859a4a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5854153130 0x7f5854073c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46568/0 (socket says 172.21.15.26:46568) 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5859a4a640 1 -- 172.21.15.26:0/3518543290 learned_addr learned my addr 172.21.15.26:0/3518543290 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5859249640 1 --2- 172.21.15.26:0/3518543290 >> v2:172.21.15.169:3300/0 conn(0x7f58540ca940 0x7f58540ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5858a48640 1 -- 172.21.15.26:0/3518543290 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189410634 0 0) 0x7f58540c7690 con 0x7f5854153130 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5858a48640 1 -- 172.21.15.26:0/3518543290 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5840003520 con 0x7f5854153130 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5858a48640 1 -- 172.21.15.26:0/3518543290 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809910576 0 0) 0x7f5854158d50 con 0x7f58540ceb40 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5858a48640 1 -- 172.21.15.26:0/3518543290 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58540c7690 con 0x7f58540ceb40 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5859249640 1 -- 172.21.15.26:0/3518543290 >> v1:172.21.15.169:6789/0 conn(0x7f58540ceb40 legacy=0x7f585415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5859249640 1 -- 172.21.15.26:0/3518543290 >> v1:172.21.15.26:6789/0 conn(0x7f5854153130 legacy=0x7f5854073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.700+0000 7f5859249640 1 -- 172.21.15.26:0/3518543290 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5854159010 con 0x7f58540ca940 2024-04-25T13:17:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.701+0000 7f5859249640 1 --2- 172.21.15.26:0/3518543290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 0x7f58540ce600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58440097a0 tx=0x7f584402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff9e863a8286d665 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.701+0000 7f5858a48640 1 -- 172.21.15.26:0/3518543290 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844037070 con 0x7f58540ca940 2024-04-25T13:17:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.701+0000 7f5858a48640 1 -- 172.21.15.26:0/3518543290 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5844032440 con 0x7f58540ca940 2024-04-25T13:17:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.701+0000 7f5858a48640 1 -- 172.21.15.26:0/3518543290 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844032810 con 0x7f58540ca940 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.702+0000 7f585bcae640 1 -- 172.21.15.26:0/3518543290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 msgr2=0x7f58540ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.702+0000 7f585bcae640 1 --2- 172.21.15.26:0/3518543290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 0x7f58540ce600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58440097a0 tx=0x7f584402a230 comp rx=0 tx=0).stop 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.702+0000 7f585bcae640 1 -- 172.21.15.26:0/3518543290 shutdown_connections 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.702+0000 7f585bcae640 1 --2- 172.21.15.26:0/3518543290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 0x7f58540ce600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.702+0000 7f585bcae640 1 -- 172.21.15.26:0/3518543290 >> 172.21.15.26:0/3518543290 conn(0x7f5854074d50 msgr2=0x7f5854075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.702+0000 7f585bcae640 1 -- 172.21.15.26:0/3518543290 shutdown_connections 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.702+0000 7f585bcae640 1 -- 172.21.15.26:0/3518543290 wait complete. 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.703+0000 7f585bcae640 1 Processor -- start 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.703+0000 7f585bcae640 1 -- start start 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.703+0000 7f585bcae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 0x7f58541575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.703+0000 7f585bcae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58540ceb40 0x7f585414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.703+0000 7f585bcae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5854153130 0x7f585415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585bcae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f58541598b0 con 0x7f5854153130 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585bcae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58541595d0 con 0x7f58540ca940 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585bcae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f58540cf500 con 0x7f58540ceb40 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5854153130 0x7f585415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5854153130 0x7f585415bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41782/0 (socket says 172.21.15.26:41782) 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 -- 172.21.15.26:0/446541484 learned_addr learned my addr 172.21.15.26:0/446541484 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f5859a4a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 0x7f58541575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f5859249640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58540ceb40 0x7f585414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 -- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58540ceb40 msgr2=0x7f585414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58540ceb40 0x7f585414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 -- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 msgr2=0x7f58541575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 0x7f58541575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 -- 172.21.15.26:0/446541484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58540cd910 con 0x7f5854153130 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585a24b640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5854153130 0x7f585415bb90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f584c00c7c0 tx=0x7f584c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f584a7fc640 1 -- 172.21.15.26:0/446541484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c003b70 con 0x7f5854153130 2024-04-25T13:17:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f584a7fc640 1 -- 172.21.15.26:0/446541484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584c003d10 con 0x7f5854153130 2024-04-25T13:17:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f584a7fc640 1 -- 172.21.15.26:0/446541484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c00aa50 con 0x7f5854153130 2024-04-25T13:17:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58540cdbb0 con 0x7f5854153130 2024-04-25T13:17:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.704+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58540ce170 con 0x7f5854153130 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.706+0000 7f584a7fc640 1 -- 172.21.15.26:0/446541484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f584c00abf0 con 0x7f5854153130 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.706+0000 7f584a7fc640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f583806c8f0 0x7f583806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.706+0000 7f584a7fc640 1 -- 172.21.15.26:0/446541484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f584c08bd80 con 0x7f5854153130 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.706+0000 7f5859a4a640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f583806c8f0 0x7f583806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.707+0000 7f5859a4a640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f583806c8f0 0x7f583806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5850000f60 tx=0x7f5850009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.707+0000 7f585e9c8740 1 Processor -- start 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.707+0000 7f585e9c8740 1 -- start start 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95690 0x562b77fd9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f94fc0 0x562b77f98f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77fe38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585e9c8740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562b77efec50 con 0x562b77f94fc0 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562b77e9b830 con 0x562b77f95a70 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x562b77efac10 con 0x562b77f95690 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f94fc0 0x562b77f98f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f94fc0 0x562b77f98f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41796/0 (socket says 172.21.15.26:41796) 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 -- 172.21.15.26:0/3998798778 learned_addr learned my addr 172.21.15.26:0/3998798778 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585a24b640 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77fe38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859a4a640 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95690 0x562b77fd9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 -- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95690 msgr2=0x562b77fd9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95690 0x562b77fd9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 -- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 msgr2=0x562b77fe38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77fe38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 -- 172.21.15.26:0/3998798778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77c112d0 con 0x562b77f94fc0 2024-04-25T13:17:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f585a24b640 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77fe38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.708+0000 7f5859249640 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f94fc0 0x562b77f98f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f58440098c0 tx=0x7f584402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e8d1ab4097cab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f58377fe640 1 -- 172.21.15.26:0/3998798778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844043070 con 0x562b77f94fc0 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f58377fe640 1 -- 172.21.15.26:0/3998798778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584403c700 con 0x562b77f94fc0 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f58377fe640 1 -- 172.21.15.26:0/3998798778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844037040 con 0x562b77f94fc0 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 -- 172.21.15.26:0/3998798778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f94fc0 msgr2=0x562b77f98f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f94fc0 0x562b77f98f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f58440098c0 tx=0x7f584402c000 comp rx=0 tx=0).stop 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 -- 172.21.15.26:0/3998798778 shutdown_connections 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77fe38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f94fc0 0x562b77f98f40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3998798778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95690 0x562b77fd9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 -- 172.21.15.26:0/3998798778 >> 172.21.15.26:0/3998798778 conn(0x562b77f96c80 msgr2=0x562b77f99580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 -- 172.21.15.26:0/3998798778 shutdown_connections 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.709+0000 7f585e9c8740 1 -- 172.21.15.26:0/3998798778 wait complete. 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.710+0000 7f585e9c8740 1 -- start start 2024-04-25T13:17:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.710+0000 7f585e9c8740 1 Processor -- start 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95690 0x562b77fc1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77feebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585e9c8740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562b77fda700 con 0x562b77f95690 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562b77e99470 con 0x562b77f95a70 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x562b77f980e0 con 0x562b77fc35e0 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585e9c8740 10 client.0 _ll_register_callbacks cb 0x562b77ebef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95690 0x562b77fc1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95690 0x562b77fc1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41808/0 (socket says 172.21.15.26:41808) 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 -- 172.21.15.26:0/45900019 learned_addr learned my addr 172.21.15.26:0/45900019 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859249640 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77feebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f585a24b640 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 -- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 msgr2=0x562b77fb9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 -- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 msgr2=0x562b77feebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77feebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 -- 172.21.15.26:0/45900019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b77cdb6b0 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5859a4a640 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95690 0x562b77fc1af0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5850014760 tx=0x7f58500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdbc747a482e80c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.711+0000 7f5834ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f5834ff9640 1 -- 172.21.15.26:0/45900019 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58500135c0 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f5834ff9640 1 -- 172.21.15.26:0/45900019 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f5850013760 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584403c700 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f5834ff9640 1 -- 172.21.15.26:0/45900019 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f585002e050 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 10 client.5004 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x562b77fc0e50 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f5834ff9640 1 -- 172.21.15.26:0/45900019 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584403c700 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f5834ff9640 1 -- 172.21.15.26:0/45900019 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f5850031020 con 0x562b77f95690 2024-04-25T13:17:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 10 client.5004 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 10 client.5004 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 20 client.5004 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b77feb3c0 0x562b77ffa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 4 client.5004 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 --> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b77f0c670 con 0x562b77feb3c0 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.712+0000 7f5859249640 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b77feb3c0 0x562b77ffa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f5834ff9640 10 client.5004 ms_handle_connect on v2:172.21.15.26:6832/4286679763 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f5859249640 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b77feb3c0 0x562b77ffa600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b7ae7f4ee3990370 server_cookie=8ec7d76188fd84af in_seq=0 out_seq=0 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f5834ff9640 1 -- 172.21.15.26:0/45900019 <== mds.2 v2:172.21.15.26:6832/4286679763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562b77f0c670 con 0x562b77feb3c0 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f5834ff9640 10 client.5004 handle_command_reply: tid=0 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 client.5004 shutdown 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95690 msgr2=0x562b77fc1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95690 0x562b77fc1af0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5850014760 tx=0x7f58500057f0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 shutdown_connections 2024-04-25T13:17:08.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b77feb3c0 0x562b77ffa600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95a70 0x562b77feebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f5834ff9640 0 client.5004 ms_handle_reset on v2:172.21.15.26:6832/4286679763 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 --2- 172.21.15.26:0/45900019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95690 0x562b77fc1af0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.713+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 >> 172.21.15.26:0/45900019 conn(0x562b77f94fc0 msgr2=0x562b77fbfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.714+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 shutdown_connections 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.714+0000 7f585e9c8740 1 -- 172.21.15.26:0/45900019 wait complete. 2024-04-25T13:17:08.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.714+0000 7f585e9c8740 20 client.5004 trim_cache size 0 max 16384 2024-04-25T13:17:08.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.732+0000 7f585e9c8740 1 Processor -- start 2024-04-25T13:17:08.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.732+0000 7f585e9c8740 1 -- start start 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f90060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95a70 0x562b77fb5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f585e9c8740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f58541fae30 con 0x562b77f95a70 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562b77fc2240 con 0x562b77f95690 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x562b77fdeb70 con 0x562b77fc35e0 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95a70 0x562b77fb5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95a70 0x562b77fb5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41812/0 (socket says 172.21.15.26:41812) 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 -- 172.21.15.26:0/3274678363 learned_addr learned my addr 172.21.15.26:0/3274678363 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f585a24b640 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 -- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 msgr2=0x562b77fb6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859a4a640 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f90060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 -- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 msgr2=0x562b77f90060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f90060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.733+0000 7f5859249640 1 -- 172.21.15.26:0/3274678363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77fc4030 con 0x562b77f95a70 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f5859249640 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95a70 0x562b77fb5ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5844006ad0 tx=0x7f5844008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ea28d236949c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f5836ffd640 1 -- 172.21.15.26:0/3274678363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844037040 con 0x562b77f95a70 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f5836ffd640 1 -- 172.21.15.26:0/3274678363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5844004340 con 0x562b77f95a70 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f5836ffd640 1 -- 172.21.15.26:0/3274678363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844043040 con 0x562b77f95a70 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 -- 172.21.15.26:0/3274678363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95a70 msgr2=0x562b77fb5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95a70 0x562b77fb5ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5844006ad0 tx=0x7f5844008030 comp rx=0 tx=0).stop 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 -- 172.21.15.26:0/3274678363 shutdown_connections 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77fc35e0 0x562b77fb6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77f95a70 0x562b77fb5ac0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 --2- 172.21.15.26:0/3274678363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f90060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 -- 172.21.15.26:0/3274678363 >> 172.21.15.26:0/3274678363 conn(0x562b77f94fc0 msgr2=0x562b77fc1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 -- 172.21.15.26:0/3274678363 shutdown_connections 2024-04-25T13:17:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.734+0000 7f585e9c8740 1 -- 172.21.15.26:0/3274678363 wait complete. 2024-04-25T13:17:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.735+0000 7f585e9c8740 1 -- start start 2024-04-25T13:17:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.735+0000 7f585e9c8740 1 Processor -- start 2024-04-25T13:17:08.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f9ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95a70 0x562b77fea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585e9c8740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77fc35e0 0x562b780537f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585e9c8740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562b77feb890 con 0x562b77fc35e0 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562b77feb240 con 0x562b77f95690 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585e9c8740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x562b77febf60 con 0x562b77f95a70 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585e9c8740 10 client.0 _ll_register_callbacks cb 0x7f5850017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77fc35e0 0x562b780537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77fc35e0 0x562b780537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41822/0 (socket says 172.21.15.26:41822) 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 -- 172.21.15.26:0/629004430 learned_addr learned my addr 172.21.15.26:0/629004430 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f5859a4a640 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f9ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f5859249640 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95a70 0x562b77fea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 -- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95a70 msgr2=0x562b77fea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95a70 0x562b77fea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 -- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 msgr2=0x562b77f9ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f9ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.736+0000 7f585a24b640 1 -- 172.21.15.26:0/629004430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b77fd99e0 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585a24b640 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77fc35e0 0x562b780537f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a430 tx=0x7f584c059390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c0a4c734021f85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f5834ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f5834ff9640 1 -- 172.21.15.26:0/629004430 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c062250 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f5834ff9640 1 -- 172.21.15.26:0/629004430 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f584c05ebb0 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5844004340 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f5834ff9640 1 -- 172.21.15.26:0/629004430 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f584c05edb0 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 10 client.5010 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x562b77f9b0a0 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f5834ff9640 1 -- 172.21.15.26:0/629004430 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5844004340 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f5834ff9640 1 -- 172.21.15.26:0/629004430 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f584c058b70 con 0x562b77fc35e0 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 10 client.5010 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 10 client.5010 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T13:17:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 20 client.5010 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b7805d860 0x562b78066230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 4 client.5010 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 --> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] -- command(tid 0: {"prefix": "status"}) -- 0x562b77f064e0 con 0x562b7805d860 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.737+0000 7f5859a4a640 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b7805d860 0x562b78066230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f5859a4a640 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b7805d860 0x562b78066230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e97410a3e039ac1 server_cookie=913334a9acc255fa in_seq=0 out_seq=0 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f5834ff9640 10 client.5010 ms_handle_connect on v2:172.21.15.26:6832/4286679763 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f5834ff9640 1 -- 172.21.15.26:0/629004430 <== mds.2 v2:172.21.15.26:6832/4286679763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562b77f064e0 con 0x562b7805d860 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f5834ff9640 10 client.5010 handle_command_reply: tid=0 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 client.5010 shutdown 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77fc35e0 msgr2=0x562b780537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77fc35e0 0x562b780537f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a430 tx=0x7f584c059390 comp rx=0 tx=0).stop 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 shutdown_connections 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b77fc35e0 0x562b780537f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.26:6832/4286679763,v1:172.21.15.26:6834/4286679763] conn(0x562b7805d860 0x562b78066230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x562b77f95a70 0x562b77fea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 --2- 172.21.15.26:0/629004430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562b77f95690 0x562b77f9ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f5834ff9640 0 client.5010 ms_handle_reset on v2:172.21.15.26:6832/4286679763 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 >> 172.21.15.26:0/629004430 conn(0x562b77f94fc0 msgr2=0x562b77fe4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 shutdown_connections 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 1 -- 172.21.15.26:0/629004430 wait complete. 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.738+0000 7f585e9c8740 20 client.5010 trim_cache size 0 max 16384 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8f4a7b84-1cd1-4957-a762-8e7959ae0a88", 2024-04-25T13:17:08.744 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 2, 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4284, 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 23.388889466999998, 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 66.008831896000004 2024-04-25T13:17:08.745 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f583806c8f0 msgr2=0x7f583806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f583806c8f0 0x7f583806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5850000f60 tx=0x7f5850009040 comp rx=0 tx=0).stop 2024-04-25T13:17:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5854153130 msgr2=0x7f585415bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5854153130 0x7f585415bb90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f584c00c7c0 tx=0x7f584c00cc80 comp rx=0 tx=0).stop 2024-04-25T13:17:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 shutdown_connections 2024-04-25T13:17:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f583806c8f0 0x7f583806edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5854153130 0x7f585415bb90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58540ceb40 0x7f585414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 --2- 172.21.15.26:0/446541484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58540ca940 0x7f58541575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 >> 172.21.15.26:0/446541484 conn(0x7f5854074d50 msgr2=0x7f5854148820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 shutdown_connections 2024-04-25T13:17:08.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.739+0000 7f585bcae640 1 -- 172.21.15.26:0/446541484 wait complete. 2024-04-25T13:17:08.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T13:17:08.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.851+0000 7fb6d555d640 1 Processor -- start 2024-04-25T13:17:08.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.851+0000 7fb6d555d640 1 -- start start 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6d555d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6d0153130 0x7fb6d0073c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6d555d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d015c620 0x7fb6d015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6d555d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d015cff0 con 0x7fb6d00ca940 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6d555d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d0159c20 con 0x7fb6d0153130 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6d555d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d00c7690 con 0x7fb6d015c620 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6ceffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6d0153130 0x7fb6d0073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6ce7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb6d00ca940 0x7fb6d00ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46584/0 (socket says 172.21.15.26:46584) 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6ce7fc640 1 -- 172.21.15.26:0/1403017244 learned_addr learned my addr 172.21.15.26:0/1403017244 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.852+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/1403017244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d015c620 0x7fb6d015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6ceffd640 1 -- 172.21.15.26:0/1403017244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d015c620 msgr2=0x7fb6d015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/1403017244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d015c620 0x7fb6d015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6ceffd640 1 -- 172.21.15.26:0/1403017244 >> v1:172.21.15.26:6789/0 conn(0x7fb6d00ca940 legacy=0x7fb6d00ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6ceffd640 1 -- 172.21.15.26:0/1403017244 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d0158d50 con 0x7fb6d0153130 2024-04-25T13:17:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6cdffb640 1 -- 172.21.15.26:0/1403017244 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502816934 0 0) 0x7fb6d015cff0 con 0x7fb6d00ca940 2024-04-25T13:17:08.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/1403017244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d015c620 0x7fb6d015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/1403017244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d0153130 0x7fb6d0073c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80097a0 tx=0x7fb6c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207c578684bbc500 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6cdffb640 1 -- 172.21.15.26:0/1403017244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8037070 con 0x7fb6d0153130 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6cdffb640 1 -- 172.21.15.26:0/1403017244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c8032440 con 0x7fb6d0153130 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.853+0000 7fb6cdffb640 1 -- 172.21.15.26:0/1403017244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8032810 con 0x7fb6d0153130 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 -- 172.21.15.26:0/1403017244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d0153130 msgr2=0x7fb6d0073c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 --2- 172.21.15.26:0/1403017244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d0153130 0x7fb6d0073c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80097a0 tx=0x7fb6c802a180 comp rx=0 tx=0).stop 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 -- 172.21.15.26:0/1403017244 shutdown_connections 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 --2- 172.21.15.26:0/1403017244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d015c620 0x7fb6d015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 --2- 172.21.15.26:0/1403017244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d0153130 0x7fb6d0073c50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 -- 172.21.15.26:0/1403017244 >> 172.21.15.26:0/1403017244 conn(0x7fb6d0074d50 msgr2=0x7fb6d0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 -- 172.21.15.26:0/1403017244 shutdown_connections 2024-04-25T13:17:08.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.854+0000 7fb6d555d640 1 -- 172.21.15.26:0/1403017244 wait complete. 2024-04-25T13:17:08.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.855+0000 7fb6d555d640 1 Processor -- start 2024-04-25T13:17:08.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.855+0000 7fb6d555d640 1 -- start start 2024-04-25T13:17:08.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6d555d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6d00ca940 0x7fb6d0148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6d555d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d0153130 0x7fb6d015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6d555d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d015c620 0x7fb6d015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6d555d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d01595d0 con 0x7fb6d015c620 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6d555d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d01592f0 con 0x7fb6d00ca940 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6d555d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d01598b0 con 0x7fb6d0153130 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d015c620 0x7fb6d015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d015c620 0x7fb6d015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41838/0 (socket says 172.21.15.26:41838) 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6cf7fe640 1 -- 172.21.15.26:0/3424695509 learned_addr learned my addr 172.21.15.26:0/3424695509 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d0153130 0x7fb6d015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6d00ca940 0x7fb6d0148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6cf7fe640 1 -- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d0153130 msgr2=0x7fb6d015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d0153130 0x7fb6d015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6cf7fe640 1 -- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6d00ca940 msgr2=0x7fb6d0148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.856+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6d00ca940 0x7fb6d0148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6cf7fe640 1 -- 172.21.15.26:0/3424695509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d0150da0 con 0x7fb6d015c620 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d0153130 0x7fb6d015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d015c620 0x7fb6d015b9d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007df0 tx=0x7fb6c000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6c77fe640 1 -- 172.21.15.26:0/3424695509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c001a070 con 0x7fb6d015c620 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6c77fe640 1 -- 172.21.15.26:0/3424695509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0003990 con 0x7fb6d015c620 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6c77fe640 1 -- 172.21.15.26:0/3424695509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0003d80 con 0x7fb6d015c620 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d01ef780 con 0x7fb6d015c620 2024-04-25T13:17:08.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.857+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d01efa60 con 0x7fb6d015c620 2024-04-25T13:17:08.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.859+0000 7fb6c77fe640 1 -- 172.21.15.26:0/3424695509 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6c001d070 con 0x7fb6d015c620 2024-04-25T13:17:08.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.859+0000 7fb6c77fe640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb6b006c8f0 0x7fb6b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.859+0000 7fb6c77fe640 1 -- 172.21.15.26:0/3424695509 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb6c008c2b0 con 0x7fb6d015c620 2024-04-25T13:17:08.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.859+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb6b006c8f0 0x7fb6b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.860+0000 7fb6d827b740 1 Processor -- start 2024-04-25T13:17:08.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.860+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb6b006c8f0 0x7fb6b006edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8034000 tx=0x7fb6c802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.860+0000 7fb6d827b740 1 -- start start 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a63aba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6366fc0 0x55d9a636af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367a70 0x55d9a63b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6d827b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d9a62d0c50 con 0x55d9a6367690 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d9a626d830 con 0x55d9a6367a70 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d9a62ccc10 con 0x55d9a6366fc0 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6ceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a63aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6ce7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6366fc0 0x55d9a636af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367a70 0x55d9a63b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6ceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a63aba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41842/0 (socket says 172.21.15.26:41842) 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6ceffd640 1 -- 172.21.15.26:0/4028842226 learned_addr learned my addr 172.21.15.26:0/4028842226 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6cf7fe640 1 -- 172.21.15.26:0/4028842226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6366fc0 msgr2=0x55d9a636af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/4028842226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6366fc0 0x55d9a636af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6cf7fe640 1 -- 172.21.15.26:0/4028842226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 msgr2=0x55d9a63aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/4028842226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a63aba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6cf7fe640 1 -- 172.21.15.26:0/4028842226 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a5fe32d0 con 0x55d9a6367a70 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.861+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/4028842226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367a70 0x55d9a63b58a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb6c008a2d0 tx=0x7fb6c0059c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c606ed78c9abcbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6c4ff9640 1 -- 172.21.15.26:0/4028842226 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0057e00 con 0x55d9a6367a70 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6c4ff9640 1 -- 172.21.15.26:0/4028842226 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0056170 con 0x55d9a6367a70 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6c4ff9640 1 -- 172.21.15.26:0/4028842226 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0059f60 con 0x55d9a6367a70 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 -- 172.21.15.26:0/4028842226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367a70 msgr2=0x55d9a63b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4028842226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367a70 0x55d9a63b58a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb6c008a2d0 tx=0x7fb6c0059c40 comp rx=0 tx=0).stop 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 -- 172.21.15.26:0/4028842226 shutdown_connections 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4028842226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367a70 0x55d9a63b58a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4028842226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6366fc0 0x55d9a636af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4028842226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a63aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 -- 172.21.15.26:0/4028842226 >> 172.21.15.26:0/4028842226 conn(0x55d9a6368c80 msgr2=0x55d9a636b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 -- 172.21.15.26:0/4028842226 shutdown_connections 2024-04-25T13:17:08.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.862+0000 7fb6d827b740 1 -- 172.21.15.26:0/4028842226 wait complete. 2024-04-25T13:17:08.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.863+0000 7fb6d827b740 1 -- start start 2024-04-25T13:17:08.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.863+0000 7fb6d827b740 1 Processor -- start 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367690 0x55d9a6395440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367a70 0x55d9a638d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6391a40 0x55d9a638db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d9a63ac700 con 0x55d9a6367a70 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d9a626b470 con 0x55d9a6367690 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d9a636a0e0 con 0x55d9a6391a40 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 10 client.0 _ll_register_callbacks cb 0x55d9a6290f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367a70 0x55d9a638d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367a70 0x55d9a638d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41854/0 (socket says 172.21.15.26:41854) 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 -- 172.21.15.26:0/391746142 learned_addr learned my addr 172.21.15.26:0/391746142 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6391a40 0x55d9a638db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367690 0x55d9a6395440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 -- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6391a40 msgr2=0x55d9a638db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6391a40 0x55d9a638db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 -- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367690 msgr2=0x55d9a6395440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367690 0x55d9a6395440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 -- 172.21.15.26:0/391746142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a60ad6b0 con 0x55d9a6367a70 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6391a40 0x55d9a638db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367a70 0x55d9a638d620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8000f60 tx=0x7fb6b80108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d426f0ed40b23c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6adffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6adffb640 1 -- 172.21.15.26:0/391746142 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8020060 con 0x55d9a6367a70 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6adffb640 1 -- 172.21.15.26:0/391746142 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb6b80016c0 con 0x55d9a6367a70 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.864+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6c0056170 con 0x55d9a6367a70 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6adffb640 1 -- 172.21.15.26:0/391746142 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb6b8026050 con 0x55d9a6367a70 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 10 client.5025 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d9a63bd2e0 con 0x55d9a6367a70 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6adffb640 1 -- 172.21.15.26:0/391746142 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0056170 con 0x55d9a6367a70 2024-04-25T13:17:08.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6adffb640 1 -- 172.21.15.26:0/391746142 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb6b8029020 con 0x55d9a6367a70 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 10 client.5025 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 10 client.5025 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 20 client.5025 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63c0be0 0x55d9a63cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 4 client.5025 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 --> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9a62de670 con 0x55d9a63c0be0 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.865+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63c0be0 0x55d9a63cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.866+0000 7fb6adffb640 10 client.5025 ms_handle_connect on v2:172.21.15.169:6834/1123161909 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.866+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63c0be0 0x55d9a63cc460 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9f7b554e368abb3 server_cookie=2698da605feeeaa3 in_seq=0 out_seq=0 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.866+0000 7fb6adffb640 1 -- 172.21.15.26:0/391746142 <== mds.1 v2:172.21.15.169:6834/1123161909 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d9a62de670 con 0x55d9a63c0be0 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.866+0000 7fb6adffb640 10 client.5025 handle_command_reply: tid=0 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.866+0000 7fb6d827b740 1 client.5025 shutdown 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367a70 msgr2=0x55d9a638d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367a70 0x55d9a638d620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8000f60 tx=0x7fb6b80108c0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 shutdown_connections 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6391a40 0x55d9a638db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367a70 0x55d9a638d620 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63c0be0 0x55d9a63cc460 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 --2- 172.21.15.26:0/391746142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6367690 0x55d9a6395440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6adffb640 0 client.5025 ms_handle_reset on v2:172.21.15.169:6834/1123161909 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 >> 172.21.15.26:0/391746142 conn(0x55d9a6366fc0 msgr2=0x55d9a636c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 shutdown_connections 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 1 -- 172.21.15.26:0/391746142 wait complete. 2024-04-25T13:17:08.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.867+0000 7fb6d827b740 20 client.5025 trim_cache size 0 max 16384 2024-04-25T13:17:08.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.885+0000 7fb6d827b740 1 Processor -- start 2024-04-25T13:17:08.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.885+0000 7fb6d827b740 1 -- start start 2024-04-25T13:17:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6393b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a63ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6d827b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d01f2f00 con 0x55d9a6367690 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d9a63bdb40 con 0x55d9a6391a40 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d9a63b6630 con 0x55d9a6367a70 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6393b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6393b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41868/0 (socket says 172.21.15.26:41868) 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 -- 172.21.15.26:0/46604806 learned_addr learned my addr 172.21.15.26:0/46604806 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a63ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 -- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 msgr2=0x55d9a63ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a63ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 -- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 msgr2=0x55d9a63adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 -- 172.21.15.26:0/46604806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a6393650 con 0x55d9a6367690 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.886+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6393b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb6c802a770 tx=0x7fb6c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934e76df3b851dc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6affff640 1 -- 172.21.15.26:0/46604806 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8037040 con 0x55d9a6367690 2024-04-25T13:17:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6affff640 1 -- 172.21.15.26:0/46604806 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c804f400 con 0x55d9a6367690 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6affff640 1 -- 172.21.15.26:0/46604806 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c804f7b0 con 0x55d9a6367690 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 -- 172.21.15.26:0/46604806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 msgr2=0x55d9a6393b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6393b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb6c802a770 tx=0x7fb6c802c000 comp rx=0 tx=0).stop 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 -- 172.21.15.26:0/46604806 shutdown_connections 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a63ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 --2- 172.21.15.26:0/46604806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6393b30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 -- 172.21.15.26:0/46604806 >> 172.21.15.26:0/46604806 conn(0x55d9a6366fc0 msgr2=0x55d9a636b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 -- 172.21.15.26:0/46604806 shutdown_connections 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.887+0000 7fb6d827b740 1 -- 172.21.15.26:0/46604806 wait complete. 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 -- start start 2024-04-25T13:17:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 Processor -- start 2024-04-25T13:17:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6387190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a6422540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63864a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d9a63c0a60 con 0x55d9a6367690 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d9a63afb50 con 0x55d9a6391a40 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d9a63c1110 con 0x55d9a6367a70 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.888+0000 7fb6d827b740 10 client.0 _ll_register_callbacks cb 0x7fb6b80072c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6387190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6387190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41876/0 (socket says 172.21.15.26:41876) 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 -- 172.21.15.26:0/4182965189 learned_addr learned my addr 172.21.15.26:0/4182965189 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6cf7fe640 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63864a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a6422540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 -- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 msgr2=0x55d9a6422540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a6422540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 -- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 msgr2=0x55d9a63864a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63864a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 -- 172.21.15.26:0/4182965189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a63bae20 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6ceffd640 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6387190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8000c00 tx=0x7fb6c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241d3cce6691a5e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6adffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6adffb640 1 -- 172.21.15.26:0/4182965189 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8037040 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6adffb640 1 -- 172.21.15.26:0/4182965189 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb6c804f7b0 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6c804f400 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6adffb640 1 -- 172.21.15.26:0/4182965189 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb6c8005990 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6d827b740 10 client.5031 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d9a6428380 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.889+0000 7fb6adffb640 1 -- 172.21.15.26:0/4182965189 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c804f400 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6adffb640 1 -- 172.21.15.26:0/4182965189 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb6c8005b30 con 0x55d9a6367690 2024-04-25T13:17:08.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 10 client.5031 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 10 client.5031 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 20 client.5031 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63924f0 0x55d9a63928d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 4 client.5031 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 --> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] -- command(tid 0: {"prefix": "status"}) -- 0x55d9a63ac4b0 con 0x55d9a63924f0 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63924f0 0x55d9a63928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6ce7fc640 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63924f0 0x55d9a63928d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edd9a0481df0f2ec server_cookie=42cb4ea6d8053abd in_seq=0 out_seq=0 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6adffb640 10 client.5031 ms_handle_connect on v2:172.21.15.169:6834/1123161909 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6adffb640 1 -- 172.21.15.26:0/4182965189 <== mds.1 v2:172.21.15.169:6834/1123161909 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d9a63ac4b0 con 0x55d9a63924f0 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6adffb640 10 client.5031 handle_command_reply: tid=0 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 client.5031 shutdown 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 msgr2=0x55d9a6387190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6387190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8000c00 tx=0x7fb6c8004730 comp rx=0 tx=0).stop 2024-04-25T13:17:08.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 shutdown_connections 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:6834/1123161909,v1:172.21.15.169:6837/1123161909] conn(0x55d9a63924f0 0x55d9a63928d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d9a6391a40 0x55d9a63864a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d9a6367a70 0x55d9a6422540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6d827b740 1 --2- 172.21.15.26:0/4182965189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d9a6367690 0x55d9a6387190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.890+0000 7fb6adffb640 0 client.5031 ms_handle_reset on v2:172.21.15.169:6834/1123161909 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 >> 172.21.15.26:0/4182965189 conn(0x55d9a6366fc0 msgr2=0x55d9a6393b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 shutdown_connections 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d827b740 1 -- 172.21.15.26:0/4182965189 wait complete. 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d827b740 20 client.5031 trim_cache size 0 max 16384 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:08.896 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8f4a7b84-1cd1-4957-a762-8e7959ae0a88", 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 1, 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4305, 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 29.573202106, 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 66.147728845000003 2024-04-25T13:17:08.897 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb6b006c8f0 msgr2=0x7fb6b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb6b006c8f0 0x7fb6b006edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8034000 tx=0x7fb6c802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d015c620 msgr2=0x7fb6d015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d015c620 0x7fb6d015b9d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007df0 tx=0x7fb6c000d4a0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 shutdown_connections 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb6b006c8f0 0x7fb6b006edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6d015c620 0x7fb6d015b9d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6d0153130 0x7fb6d015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 --2- 172.21.15.26:0/3424695509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6d00ca940 0x7fb6d0148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 >> 172.21.15.26:0/3424695509 conn(0x7fb6d0074d50 msgr2=0x7fb6d0070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 shutdown_connections 2024-04-25T13:17:08.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:08.891+0000 7fb6d555d640 1 -- 172.21.15.26:0/3424695509 wait complete. 2024-04-25T13:17:08.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T13:17:09.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.003+0000 7f29c49e5640 1 Processor -- start 2024-04-25T13:17:09.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.004+0000 7f29c49e5640 1 -- start start 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.004+0000 7f29c49e5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c0158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.004+0000 7f29c49e5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29c00cb970 0x7f29c00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.004+0000 7f29c49e5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c00ca240 con 0x7f29c00cc950 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.004+0000 7f29c49e5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f29c0159280 con 0x7f29c00cb970 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.004+0000 7f29c49e5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00ca500 con 0x7f29c0152260 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.004+0000 7f29b7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29c00cb970 0x7f29c00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29bed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f29c00cc950 0x7f29c0159710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46600/0 (socket says 172.21.15.26:46600) 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29bed9d640 1 -- 172.21.15.26:0/1672590565 learned_addr learned my addr 172.21.15.26:0/1672590565 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29be59c640 1 --2- 172.21.15.26:0/1672590565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c0158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29b7fff640 1 -- 172.21.15.26:0/1672590565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 msgr2=0x7f29c0158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1672590565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c0158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29b7fff640 1 -- 172.21.15.26:0/1672590565 >> v1:172.21.15.26:6789/0 conn(0x7f29c00cc950 legacy=0x7f29c0159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29b7fff640 1 -- 172.21.15.26:0/1672590565 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c00ca7e0 con 0x7f29c00cb970 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.005+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1672590565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c00cc410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29a80097a0 tx=0x7f29a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3cdd1bd8bf06cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29bdd9b640 1 -- 172.21.15.26:0/1672590565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8037070 con 0x7f29c00cb970 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29bdd9b640 1 -- 172.21.15.26:0/1672590565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8032440 con 0x7f29c00cb970 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29bdd9b640 1 -- 172.21.15.26:0/1672590565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8032810 con 0x7f29c00cb970 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 -- 172.21.15.26:0/1672590565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 msgr2=0x7f29c00cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1672590565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c00cc410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29a80097a0 tx=0x7f29a802a180 comp rx=0 tx=0).stop 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 -- 172.21.15.26:0/1672590565 shutdown_connections 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1672590565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c00cc410 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1672590565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c0158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 -- 172.21.15.26:0/1672590565 >> 172.21.15.26:0/1672590565 conn(0x7f29c006d610 msgr2=0x7f29c0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 -- 172.21.15.26:0/1672590565 shutdown_connections 2024-04-25T13:17:09.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.006+0000 7f29c49e5640 1 -- 172.21.15.26:0/1672590565 wait complete. 2024-04-25T13:17:09.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.007+0000 7f29c49e5640 1 Processor -- start 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29c49e5640 1 -- start start 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29c49e5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c01552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29c49e5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c00cc950 0x7f29c0146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29c49e5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c01efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29c49e5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29c00cb080 con 0x7f29c00cb970 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29c49e5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29c00cada0 con 0x7f29c00cc950 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29c49e5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00cbdb0 con 0x7f29c0152260 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c01552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c01552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41884/0 (socket says 172.21.15.26:41884) 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29be59c640 1 -- 172.21.15.26:0/1026412167 learned_addr learned my addr 172.21.15.26:0/1026412167 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c00cc950 0x7f29c0146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.008+0000 7f29bed9d640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c01efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29be59c640 1 -- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 msgr2=0x7f29c01efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29be59c640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c01efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29be59c640 1 -- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c00cc950 msgr2=0x7f29c0146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29be59c640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c00cc950 0x7f29c0146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29be59c640 1 -- 172.21.15.26:0/1026412167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01f2d60 con 0x7f29c00cb970 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29be59c640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c01552c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f29b000d800 tx=0x7f29b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29b6ffd640 1 -- 172.21.15.26:0/1026412167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b000b6c0 con 0x7f29c00cb970 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29b6ffd640 1 -- 172.21.15.26:0/1026412167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b0019070 con 0x7f29c00cb970 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c01f3000 con 0x7f29c00cb970 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29b6ffd640 1 -- 172.21.15.26:0/1026412167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b000ba80 con 0x7f29c00cb970 2024-04-25T13:17:09.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.009+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c01f35a0 con 0x7f29c00cb970 2024-04-25T13:17:09.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.011+0000 7f29b6ffd640 1 -- 172.21.15.26:0/1026412167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29b000bc20 con 0x7f29c00cb970 2024-04-25T13:17:09.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.011+0000 7f29b6ffd640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f29a006c8f0 0x7f29a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.011+0000 7f29b6ffd640 1 -- 172.21.15.26:0/1026412167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f29b008c360 con 0x7f29c00cb970 2024-04-25T13:17:09.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.011+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f29a006c8f0 0x7f29a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.012+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f29a006c8f0 0x7f29a006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.012+0000 7f29c77da740 1 Processor -- start 2024-04-25T13:17:09.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29c77da740 1 -- start start 2024-04-25T13:17:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29c77da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5e96f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed3250 0x561af5ed8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5e98720 0x561af5e98ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29c77da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561af5dfcc50 con 0x561af5ed7ca0 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561af5d99830 con 0x561af5ed3250 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561af5df8c10 con 0x561af5e98720 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5e96f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5e96f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41886/0 (socket says 172.21.15.26:41886) 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.013+0000 7f29be59c640 1 -- 172.21.15.26:0/300515845 learned_addr learned my addr 172.21.15.26:0/300515845 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29bed9d640 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5e98720 0x561af5e98ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29b7fff640 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed3250 0x561af5ed8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29be59c640 1 -- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5e98720 msgr2=0x561af5e98ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29be59c640 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5e98720 0x561af5e98ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29be59c640 1 -- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed3250 msgr2=0x561af5ed8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29be59c640 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed3250 0x561af5ed8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29be59c640 1 -- 172.21.15.26:0/300515845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561af5b0f2d0 con 0x561af5ed7ca0 2024-04-25T13:17:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f29be59c640 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5e96f40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f29b008a3f0 tx=0x7f29b0059c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadd695670eb1715 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f299ffff640 1 -- 172.21.15.26:0/300515845 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0057f70 con 0x561af5ed7ca0 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f299ffff640 1 -- 172.21.15.26:0/300515845 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b008c070 con 0x561af5ed7ca0 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.014+0000 7f299ffff640 1 -- 172.21.15.26:0/300515845 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0072080 con 0x561af5ed7ca0 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 -- 172.21.15.26:0/300515845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 msgr2=0x561af5e96f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5e96f40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f29b008a3f0 tx=0x7f29b0059c70 comp rx=0 tx=0).stop 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 -- 172.21.15.26:0/300515845 shutdown_connections 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5e98720 0x561af5e98ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed3250 0x561af5ed8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 --2- 172.21.15.26:0/300515845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5e96f40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 -- 172.21.15.26:0/300515845 >> 172.21.15.26:0/300515845 conn(0x561af5e94c80 msgr2=0x561af5e97580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 -- 172.21.15.26:0/300515845 shutdown_connections 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 -- 172.21.15.26:0/300515845 wait complete. 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 -- start start 2024-04-25T13:17:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.015+0000 7f29c77da740 1 Processor -- start 2024-04-25T13:17:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5eba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29c77da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5edb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5eb85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29c77da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561af5e990e0 con 0x561af5ed7ca0 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561af5d97470 con 0x561af5ed36f0 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561af5ec26b0 con 0x561af5ed3250 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29c77da740 10 client.0 _ll_register_callbacks cb 0x561af5dbcf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5edb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5edb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41890/0 (socket says 172.21.15.26:41890) 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29b7fff640 1 -- 172.21.15.26:0/3380738670 learned_addr learned my addr 172.21.15.26:0/3380738670 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29be59c640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5eba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.016+0000 7f29bed9d640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5eb85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29b7fff640 1 -- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 msgr2=0x561af5eba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29b7fff640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5eba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29b7fff640 1 -- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 msgr2=0x561af5eb85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29b7fff640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5eb85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29b7fff640 1 -- 172.21.15.26:0/3380738670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561af5bd96b0 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29be59c640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5eba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29b7fff640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5edb4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f29a80097a0 tx=0x7f29a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8cccd52384e48a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f299d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f299d7fa640 1 -- 172.21.15.26:0/3380738670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8037040 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f299d7fa640 1 -- 172.21.15.26:0/3380738670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f29a8048830 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b008c070 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f299d7fa640 1 -- 172.21.15.26:0/3380738670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f29a8048a30 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29c77da740 10 client.5046 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x561af5eb8af0 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f299d7fa640 1 -- 172.21.15.26:0/3380738670 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b008c070 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.017+0000 7f299d7fa640 1 -- 172.21.15.26:0/3380738670 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f29a8048bd0 con 0x561af5ed7ca0 2024-04-25T13:17:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29c77da740 10 client.5046 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29c77da740 10 client.5046 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29c77da740 20 client.5046 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29c77da740 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ef0e40 0x561af5efc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29c77da740 4 client.5046 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 --> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561af5e0a670 con 0x561af5ef0e40 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29be59c640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ef0e40 0x561af5efc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f29be59c640 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ef0e40 0x561af5efc600 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef4286a0342291ce server_cookie=d869bfb42bae3627 in_seq=0 out_seq=0 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.018+0000 7f299d7fa640 10 client.5046 ms_handle_connect on v2:172.21.15.169:6836/963417679 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f299d7fa640 1 -- 172.21.15.26:0/3380738670 <== mds.0 v2:172.21.15.169:6836/963417679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561af5e0a670 con 0x561af5ef0e40 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f299d7fa640 10 client.5046 handle_command_reply: tid=0 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 client.5046 shutdown 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 msgr2=0x561af5edb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5edb4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f29a80097a0 tx=0x7f29a8004730 comp rx=0 tx=0).stop 2024-04-25T13:17:09.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 shutdown_connections 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ef0e40 0x561af5efc600 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5eb85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed7ca0 0x561af5edb4d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 --2- 172.21.15.26:0/3380738670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5eba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f299d7fa640 0 client.5046 ms_handle_reset on v2:172.21.15.169:6836/963417679 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 >> 172.21.15.26:0/3380738670 conn(0x561af5e98720 msgr2=0x561af5e96680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 shutdown_connections 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 1 -- 172.21.15.26:0/3380738670 wait complete. 2024-04-25T13:17:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.019+0000 7f29c77da740 20 client.5046 trim_cache size 0 max 16384 2024-04-25T13:17:09.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.037+0000 7f29c77da740 1 Processor -- start 2024-04-25T13:17:09.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29c77da740 1 -- start start 2024-04-25T13:17:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5e99900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29c77da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed36f0 0x561af5f00620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed7ca0 0x561af5f00b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29c77da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01fac20 con 0x561af5ed36f0 2024-04-25T13:17:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0143180 con 0x561af5ed7ca0 2024-04-25T13:17:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561af5eedd00 con 0x561af5ed3250 2024-04-25T13:17:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed36f0 0x561af5f00620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed36f0 0x561af5f00620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41900/0 (socket says 172.21.15.26:41900) 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.038+0000 7f29b7fff640 1 -- 172.21.15.26:0/1055160665 learned_addr learned my addr 172.21.15.26:0/1055160665 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29b7fff640 1 -- 172.21.15.26:0/1055160665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 msgr2=0x561af5e99900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5e99900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29b7fff640 1 -- 172.21.15.26:0/1055160665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed7ca0 msgr2=0x561af5f00b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29bed9d640 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed7ca0 0x561af5f00b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed7ca0 0x561af5f00b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29b7fff640 1 -- 172.21.15.26:0/1055160665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561af5ed2f80 con 0x561af5ed36f0 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29b7fff640 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed36f0 0x561af5f00620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f29a802a960 tx=0x7f29a804a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafb6501115e7875 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f299f7fe640 1 -- 172.21.15.26:0/1055160665 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a80093c0 con 0x561af5ed36f0 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f299f7fe640 1 -- 172.21.15.26:0/1055160665 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8048630 con 0x561af5ed36f0 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f299f7fe640 1 -- 172.21.15.26:0/1055160665 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8053780 con 0x561af5ed36f0 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 -- 172.21.15.26:0/1055160665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed36f0 msgr2=0x561af5f00620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed36f0 0x561af5f00620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f29a802a960 tx=0x7f29a804a070 comp rx=0 tx=0).stop 2024-04-25T13:17:09.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 -- 172.21.15.26:0/1055160665 shutdown_connections 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed7ca0 0x561af5f00b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed36f0 0x561af5f00620 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 --2- 172.21.15.26:0/1055160665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed3250 0x561af5e99900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 -- 172.21.15.26:0/1055160665 >> 172.21.15.26:0/1055160665 conn(0x561af5e98720 msgr2=0x561af5eb8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.039+0000 7f29c77da740 1 -- 172.21.15.26:0/1055160665 shutdown_connections 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.040+0000 7f29c77da740 1 -- 172.21.15.26:0/1055160665 wait complete. 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.040+0000 7f29c77da740 1 -- start start 2024-04-25T13:17:09.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.040+0000 7f29c77da740 1 Processor -- start 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29c77da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed3250 0x561af5ed8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5f51910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29c77da740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed7ca0 0x561af5f51e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29c77da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561af5eee310 con 0x561af5ed3250 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561af5eb8d00 con 0x561af5ed36f0 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29c77da740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561af5ef1260 con 0x561af5ed7ca0 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29c77da740 10 client.0 _ll_register_callbacks cb 0x7f29a8040050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed3250 0x561af5ed8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed3250 0x561af5ed8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41912/0 (socket says 172.21.15.26:41912) 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 -- 172.21.15.26:0/4151498165 learned_addr learned my addr 172.21.15.26:0/4151498165 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29bed9d640 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed7ca0 0x561af5f51e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29b7fff640 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5f51910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 -- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed7ca0 msgr2=0x561af5f51e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed7ca0 0x561af5f51e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 -- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 msgr2=0x561af5f51910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5f51910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.041+0000 7f29be59c640 1 -- 172.21.15.26:0/4151498165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561af5e8e1b0 con 0x561af5ed3250 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29be59c640 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed3250 0x561af5ed8480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f29b00560d0 tx=0x7f29b008a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e67dd18502ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f299d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f299d7fa640 1 -- 172.21.15.26:0/4151498165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0057d90 con 0x561af5ed3250 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f299d7fa640 1 -- 172.21.15.26:0/4151498165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f29b008c070 con 0x561af5ed3250 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a8048630 con 0x561af5ed3250 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f299d7fa640 1 -- 172.21.15.26:0/4151498165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f29b0079050 con 0x561af5ed3250 2024-04-25T13:17:09.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 10 client.5052 fetch_fsmap learned FSMap version 19 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x561af5ec1650 con 0x561af5ed3250 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f299d7fa640 1 -- 172.21.15.26:0/4151498165 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8048630 con 0x561af5ed3250 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f299d7fa640 1 -- 172.21.15.26:0/4151498165 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f29b0013070 con 0x561af5ed3250 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 10 client.5052 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 10 client.5052 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 20 client.5052 populate_metadata read hostname 'smithi026' 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ee2830 0x561af5f644e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 4 client.5052 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 --> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] -- command(tid 0: {"prefix": "status"}) -- 0x561af5e044e0 con 0x561af5ee2830 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.042+0000 7f29b7fff640 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ee2830 0x561af5f644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29b7fff640 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ee2830 0x561af5f644e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=700909968286842b server_cookie=ff94816f5f2d5107 in_seq=0 out_seq=0 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f299d7fa640 10 client.5052 ms_handle_connect on v2:172.21.15.169:6836/963417679 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f299d7fa640 1 -- 172.21.15.26:0/4151498165 <== mds.0 v2:172.21.15.169:6836/963417679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x561af5e044e0 con 0x561af5ee2830 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f299d7fa640 10 client.5052 handle_command_reply: tid=0 2024-04-25T13:17:09.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 client.5052 shutdown 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed3250 msgr2=0x561af5ed8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed3250 0x561af5ed8480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f29b00560d0 tx=0x7f29b008a320 comp rx=0 tx=0).stop 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 shutdown_connections 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:6836/963417679,v1:172.21.15.169:6839/963417679] conn(0x561af5ee2830 0x561af5f644e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561af5ed7ca0 0x561af5f51e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561af5ed36f0 0x561af5f51910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f299d7fa640 0 client.5052 ms_handle_reset on v2:172.21.15.169:6836/963417679 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 --2- 172.21.15.26:0/4151498165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561af5ed3250 0x561af5ed8480 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 >> 172.21.15.26:0/4151498165 conn(0x561af5e98720 msgr2=0x561af5e974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 shutdown_connections 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 1 -- 172.21.15.26:0/4151498165 wait complete. 2024-04-25T13:17:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.043+0000 7f29c77da740 20 client.5052 trim_cache size 0 max 16384 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8f4a7b84-1cd1-4957-a762-8e7959ae0a88", 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4308, 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 58.820806818000001, 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 66.299637660000002 2024-04-25T13:17:09.050 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f29a006c8f0 msgr2=0x7f29a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f29a006c8f0 0x7f29a006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 msgr2=0x7f29c01552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c01552c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f29b000d800 tx=0x7f29b000dcc0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 shutdown_connections 2024-04-25T13:17:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f29a006c8f0 0x7f29a006edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29c0152260 0x7f29c01efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29c00cc950 0x7f29c0146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 --2- 172.21.15.26:0/1026412167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c00cb970 0x7f29c01552c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 >> 172.21.15.26:0/1026412167 conn(0x7f29c006d610 msgr2=0x7f29c014f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 shutdown_connections 2024-04-25T13:17:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.044+0000 7f29c49e5640 1 -- 172.21.15.26:0/1026412167 wait complete. 2024-04-25T13:17:09.055 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T13:17:09.064 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T13:17:09.065 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T13:17:09.065 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T13:17:09.065 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T13:17:09.114 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T13:17:09.114 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T13:17:09.115 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T13:17:09.115 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:17:09.115 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:09.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:09.115 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-25T13:17:09.130 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T13:17:09.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:09.131 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:17:09.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:09.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-04-25T13:17:09.290 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T13:17:09.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:17:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.395+0000 7f9aa1919640 1 Processor -- start 2024-04-25T13:17:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.395+0000 7f9aa1919640 1 -- start start 2024-04-25T13:17:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.396+0000 7f9aa1919640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a9c151ea0 0x7f9a9c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.396+0000 7f9aa1919640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.396+0000 7f9aa1919640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a9c15b610 con 0x7f9a9c152280 2024-04-25T13:17:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.396+0000 7f9aa1919640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c06f300 con 0x7f9a9c151ea0 2024-04-25T13:17:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.396+0000 7f9aa1919640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c06e6f0 con 0x7f9a9c0c3cb0 2024-04-25T13:17:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.396+0000 7f9a9affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a9c151ea0 0x7f9a9c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.396+0000 7f9a9affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a9c151ea0 0x7f9a9c0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41928/0 (socket says 172.21.15.26:41928) 2024-04-25T13:17:09.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.397+0000 7f9a9affd640 1 -- 172.21.15.26:0/1280756348 learned_addr learned my addr 172.21.15.26:0/1280756348 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:09.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.397+0000 7f9a9b7fe640 1 --2- 172.21.15.26:0/1280756348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.397+0000 7f9a9affd640 1 -- 172.21.15.26:0/1280756348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 msgr2=0x7f9a9c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.397+0000 7f9a9affd640 1 --2- 172.21.15.26:0/1280756348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.397+0000 7f9a9affd640 1 -- 172.21.15.26:0/1280756348 >> v1:172.21.15.169:6789/0 conn(0x7f9a9c152280 legacy=0x7f9a9c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.397+0000 7f9a9affd640 1 -- 172.21.15.26:0/1280756348 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c06e9d0 con 0x7f9a9c151ea0 2024-04-25T13:17:09.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.397+0000 7f9a9affd640 1 --2- 172.21.15.26:0/1280756348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0c7f10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400bb10 tx=0x7f9a9402c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79b5777f0ac69cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9a99ffb640 1 -- 172.21.15.26:0/1280756348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94035070 con 0x7f9a9c151ea0 2024-04-25T13:17:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9a99ffb640 1 -- 172.21.15.26:0/1280756348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a94031610 con 0x7f9a9c151ea0 2024-04-25T13:17:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9a99ffb640 1 -- 172.21.15.26:0/1280756348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a940319e0 con 0x7f9a9c151ea0 2024-04-25T13:17:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 -- 172.21.15.26:0/1280756348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 msgr2=0x7f9a9c0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 --2- 172.21.15.26:0/1280756348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0c7f10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400bb10 tx=0x7f9a9402c9b0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 -- 172.21.15.26:0/1280756348 shutdown_connections 2024-04-25T13:17:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 --2- 172.21.15.26:0/1280756348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 --2- 172.21.15.26:0/1280756348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0c7f10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 -- 172.21.15.26:0/1280756348 >> 172.21.15.26:0/1280756348 conn(0x7f9a9c0c8f00 msgr2=0x7f9a9c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 -- 172.21.15.26:0/1280756348 shutdown_connections 2024-04-25T13:17:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.398+0000 7f9aa1919640 1 -- 172.21.15.26:0/1280756348 wait complete. 2024-04-25T13:17:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.400+0000 7f9aa1919640 1 Processor -- start 2024-04-25T13:17:09.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.400+0000 7f9aa1919640 1 -- start start 2024-04-25T13:17:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9aa1919640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9aa1919640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9aa1919640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a9c159640 0x7f9a9c1f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9aa1919640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c0c8cb0 con 0x7f9a9c151ea0 2024-04-25T13:17:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9aa1919640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c06ef90 con 0x7f9a9c159640 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9aa1919640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c15b2d0 con 0x7f9a9c0c3cb0 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9a9a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9a9a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41938/0 (socket says 172.21.15.26:41938) 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9a9a7fc640 1 -- 172.21.15.26:0/2493239072 learned_addr learned my addr 172.21.15.26:0/2493239072 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.401+0000 7f9a9affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a9b7fe640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a9c159640 0x7f9a9c1f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a9a7fc640 1 -- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 msgr2=0x7f9a9c0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a9a7fc640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a9a7fc640 1 -- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a9c159640 msgr2=0x7f9a9c1f05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a9a7fc640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a9c159640 0x7f9a9c1f05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a9a7fc640 1 -- 172.21.15.26:0/2493239072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c14a8b0 con 0x7f9a9c151ea0 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a9a7fc640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0ca840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c3c0 tx=0x7f9a8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a93fff640 1 -- 172.21.15.26:0/2493239072 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84017070 con 0x7f9a9c151ea0 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a93fff640 1 -- 172.21.15.26:0/2493239072 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840052d0 con 0x7f9a9c151ea0 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c14ab90 con 0x7f9a9c151ea0 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9a93fff640 1 -- 172.21.15.26:0/2493239072 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84003830 con 0x7f9a9c151ea0 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.402+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c14b150 con 0x7f9a9c151ea0 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.403+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a9c068e40 con 0x7f9a9c151ea0 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.404+0000 7f9a93fff640 1 -- 172.21.15.26:0/2493239072 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a8401a070 con 0x7f9a9c151ea0 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.404+0000 7f9a93fff640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9a7c06c920 0x7f9a7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.404+0000 7f9a93fff640 1 -- 172.21.15.26:0/2493239072 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f9a8408b140 con 0x7f9a9c151ea0 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.404+0000 7f9a9affd640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9a7c06c920 0x7f9a7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.405+0000 7f9a9affd640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9a7c06c920 0x7f9a7c06ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a94037000 tx=0x7f9a94032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.408+0000 7f9a93fff640 1 -- 172.21.15.26:0/2493239072 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a84058ae0 con 0x7f9a9c151ea0 2024-04-25T13:17:09.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.637+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9a9c14bf20 con 0x7f9a9c151ea0 2024-04-25T13:17:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.637+0000 7f9a93fff640 1 -- 172.21.15.26:0/2493239072 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+88 (secure 0 0 0) 0x7f9a8405cde0 con 0x7f9a9c151ea0 2024-04-25T13:17:09.637 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:17:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9a7c06c920 msgr2=0x7f9a7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9a7c06c920 0x7f9a7c06ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a94037000 tx=0x7f9a94032000 comp rx=0 tx=0).stop 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 msgr2=0x7f9a9c0ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0ca840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c3c0 tx=0x7f9a8400c880 comp rx=0 tx=0).stop 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 shutdown_connections 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f9a7c06c920 0x7f9a7c06ede0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a9c159640 0x7f9a9c1f05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a9c151ea0 0x7f9a9c0ca840 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 --2- 172.21.15.26:0/2493239072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a9c0c3cb0 0x7f9a9c0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 >> 172.21.15.26:0/2493239072 conn(0x7f9a9c0c8f00 msgr2=0x7f9a9c1e31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.639+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 shutdown_connections 2024-04-25T13:17:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09.640+0000 7f9aa1919640 1 -- 172.21.15.26:0/2493239072 wait complete. 2024-04-25T13:17:09.651 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:17:09.651 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:17:09.651 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-04-25T13:17:09.651 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:17:09.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:09.652 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:17:09.652 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:17:09.652 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:17:09.652 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:17:09.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:09.652 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-04-25T13:17:09.667 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:17:09.667 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-04-25T13:17:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T13:17:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42643sec preferred_lft 42643sec 2024-04-25T13:17:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link noprefixroute 2024-04-25T13:17:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:09.669 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-04-25T13:17:09.669 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:17:09.669 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:09.669 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:17:09.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:17:09.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2024-04-25T13:17:09.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2024-04-25T13:17:09.670 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:17:09.670 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:17:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:09.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:09.807 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:17:09.829 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-04-25T13:17:09.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:09.831 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-04-25T13:17:09.887 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-04-25T13:17:09.888 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:17:09.888 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T13:17:09.888 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T13:17:09.888 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:17:09.888 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:09.888 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:17:09.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T13:17:09.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T13:17:09.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T13:17:09.888 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:17:09.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:10.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:10.014 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-25T13:17:10.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:10.029 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-04-25T13:17:10.085 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:10.085 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:17:10.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:10.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T13:17:10.085 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:17:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:10.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:10.202 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T13:17:10.203 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:17:10.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:10.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:10.316 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:10.316 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-25T13:17:10.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-04-25T13:17:10.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:17:10.316 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-25T13:17:10.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:10.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:10.393 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T13:17:10.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:17:10.393 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:10.408 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:17:10.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:17:10.408 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:10.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-25T13:17:10.528 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:17:10.586 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-25T13:17:10.587 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-25T13:17:10.587 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-25T13:17:10.587 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-25T13:17:10.587 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-25T13:17:10.587 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-25T13:17:10.588 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-25T13:17:10.588 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-25T13:17:10.588 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-25T13:17:10.588 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-25T13:17:10.588 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-25T13:17:10.589 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/selinux 2024-04-25T13:17:10.589 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:17:10.589 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-25T13:17:10.589 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-25T13:17:10.589 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-25T13:17:10.590 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-25T13:17:10.590 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:17:10.590 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-25T13:17:10.590 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:17:10.590 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-25T13:17:10.590 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:17:10.590 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-25T13:17:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:10.592 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:10.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:10.592 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-25T13:17:10.645 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:17:10.645 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T13:17:10.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-25T13:17:10.717 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:17:10.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2024-04-25T13:17:10.773+0000 7f5586617480 -1 init, newargv = 0x56087f4d1a10 newargc=15 2024-04-25T13:17:10.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[45196]: starting ceph client 2024-04-25T13:17:10.780 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-25T13:17:10.780 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-25T13:17:10.780 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-25T13:17:10.780 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/selinux 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:17:10.781 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:10.782 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:10.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:10.783 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-25T13:17:10.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[45196]: starting fuse 2024-04-25T13:17:11.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-25T13:17:11.996 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:17:12.052 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-25T13:17:12.052 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-25T13:17:12.052 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-25T13:17:12.052 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-25T13:17:12.052 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/selinux 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:17:12.053 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:12.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:12.055 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-25T13:17:12.111 INFO:teuthology.orchestra.run.smithi026.stdout:43 2024-04-25T13:17:12.111 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T13:17:12.111 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:17:12.111 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2024-04-25T13:17:12.111 DEBUG:teuthology.orchestra.run.smithi026:> import re 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> import os 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:17:12.112 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:17:12.113 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2024-04-25T13:17:12.113 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2024-04-25T13:17:12.113 DEBUG:teuthology.orchestra.run.smithi026:> return f 2024-04-25T13:17:12.113 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:17:12.113 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-25T13:17:12.113 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2024-04-25T13:17:12.113 DEBUG:teuthology.orchestra.run.smithi026:> ' 2024-04-25T13:17:12.232 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.45196.asok 2024-04-25T13:17:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:12.244 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45196.asok 2024-04-25T13:17:12.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:12.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45196.asok status 2024-04-25T13:17:12.382 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:12.382 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2024-04-25T13:17:12.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T13:17:12.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T13:17:12.382 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2024-04-25T13:17:12.382 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2024-04-25T13:17:12.382 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "45196", 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5064, 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 5064 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3275695298 2024-04-25T13:17:12.383 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3275695298 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.5064 192.168.0.1:0/3275695298", 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/3275695298", 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2024-04-25T13:17:12.384 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 19, 2024-04-25T13:17:12.386 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 26, 2024-04-25T13:17:12.386 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:17:12.386 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2024-04-25T13:17:12.386 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2024-04-25T13:17:12.386 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:12.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:12.391 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2024-04-25T13:17:12.391 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:12.407 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2024-04-25T13:17:12.407 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:12.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:12.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:12.471 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-25T13:17:12.485 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T13:17:12.715 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=db59ab1d22c340e99d483475734e602c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T13:17:12.717 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-25T13:17:12.726 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T13:17:12.799 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T13:17:12.799 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:17:12.799 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:12.819 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:17:12.819 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:12.875 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:13.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.016+0000 7f3083d94640 1 Processor -- start 2024-04-25T13:17:13.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.016+0000 7f3083d94640 1 -- start start 2024-04-25T13:17:13.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f3083d94640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f307c152280 0x7f307c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f3083d94640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0c3cb0 0x7f307c159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f3083d94640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307c15b610 con 0x7f307c151ea0 2024-04-25T13:17:13.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f3083d94640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f307c06f300 con 0x7f307c152280 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f3083d94640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f307c06e6f0 con 0x7f307c0c3cb0 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f308132f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f307c152280 0x7f307c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f308132f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f307c152280 0x7f307c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41952/0 (socket says 172.21.15.26:41952) 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f308132f640 1 -- 172.21.15.26:0/3230450199 learned_addr learned my addr 172.21.15.26:0/3230450199 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f3082331640 1 --2- 172.21.15.26:0/3230450199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0c3cb0 0x7f307c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f308132f640 1 -- 172.21.15.26:0/3230450199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0c3cb0 msgr2=0x7f307c159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.017+0000 7f308132f640 1 --2- 172.21.15.26:0/3230450199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0c3cb0 0x7f307c159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.018+0000 7f308132f640 1 -- 172.21.15.26:0/3230450199 >> v1:172.21.15.169:6789/0 conn(0x7f307c151ea0 legacy=0x7f307c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.018+0000 7f308132f640 1 -- 172.21.15.26:0/3230450199 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c06e9d0 con 0x7f307c152280 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.018+0000 7f308132f640 1 --2- 172.21.15.26:0/3230450199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c152280 0x7f307c1591d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3070009870 tx=0x7f307002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3344163d29105c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.018+0000 7f3080b2e640 1 -- 172.21.15.26:0/3230450199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070037070 con 0x7f307c152280 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.018+0000 7f3080b2e640 1 -- 172.21.15.26:0/3230450199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307002ae50 con 0x7f307c152280 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.018+0000 7f3080b2e640 1 -- 172.21.15.26:0/3230450199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070032860 con 0x7f307c152280 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 -- 172.21.15.26:0/3230450199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c152280 msgr2=0x7f307c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 --2- 172.21.15.26:0/3230450199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c152280 0x7f307c1591d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3070009870 tx=0x7f307002a300 comp rx=0 tx=0).stop 2024-04-25T13:17:13.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 -- 172.21.15.26:0/3230450199 shutdown_connections 2024-04-25T13:17:13.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 --2- 172.21.15.26:0/3230450199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0c3cb0 0x7f307c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 --2- 172.21.15.26:0/3230450199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c152280 0x7f307c1591d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 -- 172.21.15.26:0/3230450199 >> 172.21.15.26:0/3230450199 conn(0x7f307c0c8f00 msgr2=0x7f307c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 -- 172.21.15.26:0/3230450199 shutdown_connections 2024-04-25T13:17:13.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.019+0000 7f3083d94640 1 -- 172.21.15.26:0/3230450199 wait complete. 2024-04-25T13:17:13.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.020+0000 7f3083d94640 1 Processor -- start 2024-04-25T13:17:13.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.020+0000 7f3083d94640 1 -- start start 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3083d94640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307c0c3cb0 0x7f307c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3083d94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c151ea0 0x7f307c147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3083d94640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0ca300 0x7f307c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3083d94640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f307c0c8cb0 con 0x7f307c151ea0 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3083d94640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f307c06ef90 con 0x7f307c0c3cb0 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3083d94640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f307c15b2d0 con 0x7f307c0ca300 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c151ea0 0x7f307c147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c151ea0 0x7f307c147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41968/0 (socket says 172.21.15.26:41968) 2024-04-25T13:17:13.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 -- 172.21.15.26:0/2493587044 learned_addr learned my addr 172.21.15.26:0/2493587044 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:13.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3081b30640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307c0c3cb0 0x7f307c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f3082331640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0ca300 0x7f307c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 -- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0ca300 msgr2=0x7f307c0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0ca300 0x7f307c0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 -- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307c0c3cb0 msgr2=0x7f307c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307c0c3cb0 0x7f307c0cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.021+0000 7f308132f640 1 -- 172.21.15.26:0/2493587044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c147ab0 con 0x7f307c151ea0 2024-04-25T13:17:13.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.022+0000 7f308132f640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c151ea0 0x7f307c147570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3070000c00 tx=0x7f30700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.022+0000 7f306e7fc640 1 -- 172.21.15.26:0/2493587044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070041070 con 0x7f307c151ea0 2024-04-25T13:17:13.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.022+0000 7f306e7fc640 1 -- 172.21.15.26:0/2493587044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307003c670 con 0x7f307c151ea0 2024-04-25T13:17:13.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.022+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c0ca840 con 0x7f307c151ea0 2024-04-25T13:17:13.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.022+0000 7f306e7fc640 1 -- 172.21.15.26:0/2493587044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070037040 con 0x7f307c151ea0 2024-04-25T13:17:13.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.022+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c15aaf0 con 0x7f307c151ea0 2024-04-25T13:17:13.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.023+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307c068e40 con 0x7f307c151ea0 2024-04-25T13:17:13.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.023+0000 7f306e7fc640 1 -- 172.21.15.26:0/2493587044 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3070044070 con 0x7f307c151ea0 2024-04-25T13:17:13.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.024+0000 7f306e7fc640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f306006c920 0x7f306006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.024+0000 7f306e7fc640 1 -- 172.21.15.26:0/2493587044 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f30700ac9f0 con 0x7f307c151ea0 2024-04-25T13:17:13.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.024+0000 7f3081b30640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f306006c920 0x7f306006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.024+0000 7f3081b30640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f306006c920 0x7f306006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3078001640 tx=0x7f3078009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.028+0000 7f306e7fc640 1 -- 172.21.15.26:0/2493587044 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f307007aa70 con 0x7f307c151ea0 2024-04-25T13:17:13.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.214+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f307c145a50 con 0x7f307c151ea0 2024-04-25T13:17:13.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.216+0000 7f306e7fc640 1 -- 172.21.15.26:0/2493587044 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18947 (secure 0 0 0) 0x7f307007a370 con 0x7f307c151ea0 2024-04-25T13:17:13.216 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:13.216 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:50.350764+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f306006c920 msgr2=0x7f306006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f306006c920 0x7f306006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3078001640 tx=0x7f3078009040 comp rx=0 tx=0).stop 2024-04-25T13:17:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c151ea0 msgr2=0x7f307c147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c151ea0 0x7f307c147570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3070000c00 tx=0x7f30700046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 shutdown_connections 2024-04-25T13:17:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f306006c920 0x7f306006ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f307c0ca300 0x7f307c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f307c151ea0 0x7f307c147570 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.217+0000 7f3083d94640 1 --2- 172.21.15.26:0/2493587044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f307c0c3cb0 0x7f307c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.218+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 >> 172.21.15.26:0/2493587044 conn(0x7f307c0c8f00 msgr2=0x7f307c0c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.218+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 shutdown_connections 2024-04-25T13:17:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.218+0000 7f3083d94640 1 -- 172.21.15.26:0/2493587044 wait complete. 2024-04-25T13:17:13.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:07.306201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:08.537870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:12.230813+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:13.229 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:13.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.333+0000 7f50a5975640 1 Processor -- start 2024-04-25T13:17:13.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.333+0000 7f50a5975640 1 -- start start 2024-04-25T13:17:13.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.334+0000 7f50a5975640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f50a0152f20 0x7f50a00cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.334+0000 7f50a5975640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 0x7f50a00cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.334+0000 7f50a5975640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a00c7b20 con 0x7f50a0153300 2024-04-25T13:17:13.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.334+0000 7f50a5975640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f50a00c9810 con 0x7f50a0152f20 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.334+0000 7f50a5975640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50a00cac60 con 0x7f50a00ca3b0 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.334+0000 7f509e7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f50a0153300 0x7f50a00c9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46602/0 (socket says 172.21.15.26:46602) 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.334+0000 7f509e7fc640 1 -- 172.21.15.26:0/1783675483 learned_addr learned my addr 172.21.15.26:0/1783675483 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509f7fe640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 0x7f50a00cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 --2- 172.21.15.26:0/1783675483 >> v2:172.21.15.169:3300/0 conn(0x7f50a0152f20 0x7f50a00cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747352644 0 0) 0x7f50a00c7b20 con 0x7f50a0153300 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f508c003520 con 0x7f50a0153300 2024-04-25T13:17:13.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4220115914 0 0) 0x7f508c003520 con 0x7f50a0153300 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 msgr2=0x7f50a00cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 0x7f50a00cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 >> v2:172.21.15.169:3300/0 conn(0x7f50a0152f20 msgr2=0x7f50a00cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 --2- 172.21.15.26:0/1783675483 >> v2:172.21.15.169:3300/0 conn(0x7f50a0152f20 0x7f50a00cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a00c7d90 con 0x7f50a0153300 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f5088001670 con 0x7f50a0153300 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 --2- 172.21.15.26:0/1783675483 >> v2:172.21.15.169:3300/0 conn(0x7f50a0152f20 0x7f50a00cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 >> v1:172.21.15.26:6789/0 conn(0x7f50a0153300 legacy=0x7f50a00c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f508c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 0x7f508c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f508c004d40 0x7f508c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00cac60 con 0x7f508c0039b0 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f508c00b9c0 con 0x7f508c004d40 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f508c00bb40 con 0x7f50a00ca3b0 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f508c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509e7fc640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 0x7f508c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509f7fe640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f508c004d40 0x7f508c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 -- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 msgr2=0x7f508c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 0x7f508c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 -- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f508c004d40 msgr2=0x7f508c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f508c004d40 0x7f508c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509effd640 1 -- 172.21.15.26:0/1783675483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c003520 con 0x7f508c0039b0 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.335+0000 7f509e7fc640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a00ca3b0 0x7f508c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.336+0000 7f509effd640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f508c003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5098009c90 tx=0x7f508c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4886600539fba16f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.336+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098036070 con 0x7f508c0039b0 2024-04-25T13:17:13.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.336+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5098031400 con 0x7f508c0039b0 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.336+0000 7f509dffb640 1 -- 172.21.15.26:0/1783675483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098009860 con 0x7f508c0039b0 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.337+0000 7f50a5975640 1 -- 172.21.15.26:0/1783675483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 msgr2=0x7f508c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.337+0000 7f50a5975640 1 --2- 172.21.15.26:0/1783675483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f508c003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5098009c90 tx=0x7f508c005830 comp rx=0 tx=0).stop 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.337+0000 7f509f7fe640 1 -- 172.21.15.26:0/1783675483 reap_dead start 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.337+0000 7f50a5975640 1 -- 172.21.15.26:0/1783675483 shutdown_connections 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.337+0000 7f50a5975640 1 -- 172.21.15.26:0/1783675483 >> 172.21.15.26:0/1783675483 conn(0x7f50a0074f30 msgr2=0x7f50a0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.337+0000 7f50a5975640 1 -- 172.21.15.26:0/1783675483 shutdown_connections 2024-04-25T13:17:13.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.337+0000 7f50a5975640 1 -- 172.21.15.26:0/1783675483 wait complete. 2024-04-25T13:17:13.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.338+0000 7f50a5975640 1 Processor -- start 2024-04-25T13:17:13.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.338+0000 7f50a5975640 1 -- start start 2024-04-25T13:17:13.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f50a5975640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f50a01546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f50a5975640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0151d20 0x7f50a014e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f50a5975640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a014ed50 0x7f50a0144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f50a5975640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00c8630 con 0x7f508c0039b0 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f50a5975640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00c8350 con 0x7f50a0151d20 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f50a5975640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50a00c8910 con 0x7f50a014ed50 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f50a01546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f50a01546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41980/0 (socket says 172.21.15.26:41980) 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 -- 172.21.15.26:0/3118558862 learned_addr learned my addr 172.21.15.26:0/3118558862 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509e7fc640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0151d20 0x7f50a014e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509f7fe640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a014ed50 0x7f50a0144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 -- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a014ed50 msgr2=0x7f50a0144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a014ed50 0x7f50a0144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 -- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0151d20 msgr2=0x7f50a014e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0151d20 0x7f50a014e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 -- 172.21.15.26:0/3118558862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a014f1d0 con 0x7f508c0039b0 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509f7fe640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a014ed50 0x7f50a0144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.339+0000 7f509effd640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f50a01546b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5098009db0 tx=0x7f5098004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.340+0000 7f5097fff640 1 -- 172.21.15.26:0/3118558862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098040020 con 0x7f508c0039b0 2024-04-25T13:17:13.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.340+0000 7f5097fff640 1 -- 172.21.15.26:0/3118558862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509803b680 con 0x7f508c0039b0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.340+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a00c53c0 con 0x7f508c0039b0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.340+0000 7f5097fff640 1 -- 172.21.15.26:0/3118558862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098036040 con 0x7f508c0039b0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.340+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a014d970 con 0x7f508c0039b0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.341+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a0068f50 con 0x7f508c0039b0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.341+0000 7f5097fff640 1 -- 172.21.15.26:0/3118558862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5098043020 con 0x7f508c0039b0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.342+0000 7f5097fff640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f508006c8f0 0x7f508006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.342+0000 7f5097fff640 1 -- 172.21.15.26:0/3118558862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f50980ac590 con 0x7f508c0039b0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.342+0000 7f509e7fc640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f508006c8f0 0x7f508006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.342+0000 7f509e7fc640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f508006c8f0 0x7f508006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50a0158d30 tx=0x7f5088007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.346+0000 7f5097fff640 1 -- 172.21.15.26:0/3118558862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f509804a030 con 0x7f508c0039b0 2024-04-25T13:17:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.531+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f50a0075650 con 0x7f508c0039b0 2024-04-25T13:17:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.531+0000 7f5097fff640 1 -- 172.21.15.26:0/3118558862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f50a014f1d0 con 0x7f508c0039b0 2024-04-25T13:17:13.531 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:17:13.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f508006c8f0 msgr2=0x7f508006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f508006c8f0 0x7f508006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50a0158d30 tx=0x7f5088007040 comp rx=0 tx=0).stop 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 msgr2=0x7f50a01546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f50a01546b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5098009db0 tx=0x7f5098004730 comp rx=0 tx=0).stop 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 shutdown_connections 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f508006c8f0 0x7f508006edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50a014ed50 0x7f50a0144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0151d20 0x7f50a014e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 --2- 172.21.15.26:0/3118558862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f508c0039b0 0x7f50a01546b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 >> 172.21.15.26:0/3118558862 conn(0x7f50a0074f30 msgr2=0x7f50a014fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 shutdown_connections 2024-04-25T13:17:13.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.533+0000 7f50a5975640 1 -- 172.21.15.26:0/3118558862 wait complete. 2024-04-25T13:17:13.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:13.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.648+0000 7fe72dfbf640 1 Processor -- start 2024-04-25T13:17:13.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.648+0000 7fe72dfbf640 1 -- start start 2024-04-25T13:17:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe72dfbf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe728155250 0x7fe728072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe72dfbf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe7280734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe72dfbf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72815bf90 con 0x7fe7280ccd30 2024-04-25T13:17:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe72dfbf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe72815f2d0 con 0x7fe728155250 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe72dfbf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe72815e6c0 con 0x7fe7280b3840 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe7280734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe7277fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe728155250 0x7fe728072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe7280734c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:45218/0 (socket says 172.21.15.26:45218) 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.649+0000 7fe726ffd640 1 -- 172.21.15.26:0/1778147532 learned_addr learned my addr 172.21.15.26:0/1778147532 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.650+0000 7fe726ffd640 1 -- 172.21.15.26:0/1778147532 >> v2:172.21.15.169:3300/0 conn(0x7fe728155250 msgr2=0x7fe728072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.650+0000 7fe726ffd640 1 --2- 172.21.15.26:0/1778147532 >> v2:172.21.15.169:3300/0 conn(0x7fe728155250 0x7fe728072f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.650+0000 7fe726ffd640 1 -- 172.21.15.26:0/1778147532 >> v1:172.21.15.169:6789/0 conn(0x7fe7280ccd30 legacy=0x7fe7280c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.650+0000 7fe7267fc640 1 -- 172.21.15.26:0/1778147532 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946882679 0 0) 0x7fe72815bf90 con 0x7fe7280ccd30 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.650+0000 7fe726ffd640 1 -- 172.21.15.26:0/1778147532 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72815e9a0 con 0x7fe7280b3840 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.650+0000 7fe7277fe640 1 --2- 172.21.15.26:0/1778147532 >> v2:172.21.15.169:3300/0 conn(0x7fe728155250 0x7fe728072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe726ffd640 1 --2- 172.21.15.26:0/1778147532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe7280734c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009870 tx=0x7fe71c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01bbb4c78dfbffb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe7267fc640 1 -- 172.21.15.26:0/1778147532 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c037070 con 0x7fe7280b3840 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe7267fc640 1 -- 172.21.15.26:0/1778147532 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c02ae50 con 0x7fe7280b3840 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe7267fc640 1 -- 172.21.15.26:0/1778147532 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c032860 con 0x7fe7280b3840 2024-04-25T13:17:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 -- 172.21.15.26:0/1778147532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 msgr2=0x7fe7280734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/1778147532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe7280734c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009870 tx=0x7fe71c02a300 comp rx=0 tx=0).stop 2024-04-25T13:17:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 -- 172.21.15.26:0/1778147532 shutdown_connections 2024-04-25T13:17:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/1778147532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe7280734c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/1778147532 >> v2:172.21.15.169:3300/0 conn(0x7fe728155250 0x7fe728072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 -- 172.21.15.26:0/1778147532 >> 172.21.15.26:0/1778147532 conn(0x7fe7280d0a00 msgr2=0x7fe7280d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 -- 172.21.15.26:0/1778147532 shutdown_connections 2024-04-25T13:17:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.651+0000 7fe72dfbf640 1 -- 172.21.15.26:0/1778147532 wait complete. 2024-04-25T13:17:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.652+0000 7fe72dfbf640 1 Processor -- start 2024-04-25T13:17:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe72dfbf640 1 -- start start 2024-04-25T13:17:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe72dfbf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe72814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe72dfbf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7280ccd30 0x7fe7280b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe72dfbf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728155250 0x7fe7281f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe72dfbf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe72815bb50 con 0x7fe728155250 2024-04-25T13:17:13.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe72dfbf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe72815ef60 con 0x7fe7280ccd30 2024-04-25T13:17:13.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe72dfbf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe72815bcd0 con 0x7fe7280b3840 2024-04-25T13:17:13.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe727fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728155250 0x7fe7281f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe727fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728155250 0x7fe7281f44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53472/0 (socket says 172.21.15.26:53472) 2024-04-25T13:17:13.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.653+0000 7fe727fff640 1 -- 172.21.15.26:0/2729687811 learned_addr learned my addr 172.21.15.26:0/2729687811 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:13.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe7277fe640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe72814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe726ffd640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7280ccd30 0x7fe7280b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe727fff640 1 -- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 msgr2=0x7fe72814f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe727fff640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe72814f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe727fff640 1 -- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7280ccd30 msgr2=0x7fe7280b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe727fff640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7280ccd30 0x7fe7280b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe727fff640 1 -- 172.21.15.26:0/2729687811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe728153e10 con 0x7fe728155250 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe727fff640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728155250 0x7fe7281f44f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe72000c780 tx=0x7fe72000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe70ffff640 1 -- 172.21.15.26:0/2729687811 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720017070 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe70ffff640 1 -- 172.21.15.26:0/2729687811 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720003dc0 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72814fc50 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe70ffff640 1 -- 172.21.15.26:0/2729687811 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7200052b0 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.654+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe728158080 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.655+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7280cf5f0 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.656+0000 7fe70ffff640 1 -- 172.21.15.26:0/2729687811 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe72001a070 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.656+0000 7fe70ffff640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe71406c8f0 0x7fe71406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.656+0000 7fe70ffff640 1 -- 172.21.15.26:0/2729687811 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fe72008b530 con 0x7fe728155250 2024-04-25T13:17:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.656+0000 7fe7277fe640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe71406c8f0 0x7fe71406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.657+0000 7fe7277fe640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe71406c8f0 0x7fe71406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe718009560 tx=0x7fe718009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.660+0000 7fe70ffff640 1 -- 172.21.15.26:0/2729687811 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe7280cf5f0 con 0x7fe728155250 2024-04-25T13:17:13.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.843+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe728154d90 con 0x7fe728155250 2024-04-25T13:17:13.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.843+0000 7fe70ffff640 1 -- 172.21.15.26:0/2729687811 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fe720058ed0 con 0x7fe728155250 2024-04-25T13:17:13.844 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:17:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe71406c8f0 msgr2=0x7fe71406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe71406c8f0 0x7fe71406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe718009560 tx=0x7fe718009190 comp rx=0 tx=0).stop 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728155250 msgr2=0x7fe7281f44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728155250 0x7fe7281f44f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe72000c780 tx=0x7fe72000cc40 comp rx=0 tx=0).stop 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 shutdown_connections 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe71406c8f0 0x7fe71406edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe728155250 0x7fe7281f44f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7280ccd30 0x7fe7280b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 --2- 172.21.15.26:0/2729687811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7280b3840 0x7fe72814f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 >> 172.21.15.26:0/2729687811 conn(0x7fe7280d0a00 msgr2=0x7fe7280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 shutdown_connections 2024-04-25T13:17:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.845+0000 7fe72dfbf640 1 -- 172.21.15.26:0/2729687811 wait complete. 2024-04-25T13:17:13.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:13.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.959+0000 7f01b05bf640 1 Processor -- start 2024-04-25T13:17:13.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.959+0000 7f01b05bf640 1 -- start start 2024-04-25T13:17:13.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01b05bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8340 0x7f01a80723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01b05bf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01a80c8720 0x7f01a8151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01b05bf640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a8157d70 con 0x7f01a8158b10 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01b05bf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f01a8158680 con 0x7f01a80c8720 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01b05bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01a815be10 con 0x7f01a80c8340 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01adb5a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f01a8158b10 0x7f01a815b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34246/0 (socket says 172.21.15.26:34246) 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01adb5a640 1 -- 172.21.15.26:0/1503450107 learned_addr learned my addr 172.21.15.26:0/1503450107 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01ae35b640 1 --2- 172.21.15.26:0/1503450107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8340 0x7f01a80723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01aeb5c640 1 --2- 172.21.15.26:0/1503450107 >> v2:172.21.15.169:3300/0 conn(0x7f01a80c8720 0x7f01a8151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01ad359640 1 -- 172.21.15.26:0/1503450107 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665924607 0 0) 0x7f01a8157d70 con 0x7f01a8158b10 2024-04-25T13:17:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.960+0000 7f01ad359640 1 -- 172.21.15.26:0/1503450107 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0190003520 con 0x7f01a8158b10 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.961+0000 7f01ae35b640 1 -- 172.21.15.26:0/1503450107 >> v2:172.21.15.169:3300/0 conn(0x7f01a80c8720 msgr2=0x7f01a8151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.961+0000 7f01ae35b640 1 --2- 172.21.15.26:0/1503450107 >> v2:172.21.15.169:3300/0 conn(0x7f01a80c8720 0x7f01a8151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.961+0000 7f01ae35b640 1 -- 172.21.15.26:0/1503450107 >> v1:172.21.15.26:6789/0 conn(0x7f01a8158b10 legacy=0x7f01a815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.961+0000 7f01ae35b640 1 -- 172.21.15.26:0/1503450107 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a815c0f0 con 0x7f01a80c8340 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.961+0000 7f01ae35b640 1 --2- 172.21.15.26:0/1503450107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8340 0x7f01a80723b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f01a00097a0 tx=0x7f01a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85f925253839fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.961+0000 7f01ad359640 1 -- 172.21.15.26:0/1503450107 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0037070 con 0x7f01a80c8340 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01ad359640 1 -- 172.21.15.26:0/1503450107 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a0032440 con 0x7f01a80c8340 2024-04-25T13:17:13.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01ad359640 1 -- 172.21.15.26:0/1503450107 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a00327f0 con 0x7f01a80c8340 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 -- 172.21.15.26:0/1503450107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8340 msgr2=0x7f01a80723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1503450107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8340 0x7f01a80723b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f01a00097a0 tx=0x7f01a002a180 comp rx=0 tx=0).stop 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 -- 172.21.15.26:0/1503450107 shutdown_connections 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1503450107 >> v2:172.21.15.169:3300/0 conn(0x7f01a80c8720 0x7f01a8151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1503450107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8340 0x7f01a80723b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 -- 172.21.15.26:0/1503450107 >> 172.21.15.26:0/1503450107 conn(0x7f01a806d660 msgr2=0x7f01a8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 -- 172.21.15.26:0/1503450107 shutdown_connections 2024-04-25T13:17:13.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.962+0000 7f01b05bf640 1 -- 172.21.15.26:0/1503450107 wait complete. 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.963+0000 7f01b05bf640 1 Processor -- start 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.963+0000 7f01b05bf640 1 -- start start 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01b05bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a80c8340 0x7f01a815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01b05bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8720 0x7f01a815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01b05bf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a8158b10 0x7f01a81544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01b05bf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f01a80728f0 con 0x7f01a8158b10 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01b05bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8158310 con 0x7f01a80c8340 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01b05bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01a815ba70 con 0x7f01a80c8720 2024-04-25T13:17:13.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a8158b10 0x7f01a81544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a8158b10 0x7f01a81544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53478/0 (socket says 172.21.15.26:53478) 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 -- 172.21.15.26:0/1987319326 learned_addr learned my addr 172.21.15.26:0/1987319326 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01adb5a640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8720 0x7f01a815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01ae35b640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a80c8340 0x7f01a815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 -- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8720 msgr2=0x7f01a815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8720 0x7f01a815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 -- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a80c8340 msgr2=0x7f01a815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a80c8340 0x7f01a815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.964+0000 7f01aeb5c640 1 -- 172.21.15.26:0/1987319326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a80ccd00 con 0x7f01a8158b10 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.965+0000 7f01ae35b640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a80c8340 0x7f01a815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.965+0000 7f01aeb5c640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a8158b10 0x7f01a81544e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0198009dd0 tx=0x7f019800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.965+0000 7f01a6ffd640 1 -- 172.21.15.26:0/1987319326 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198018020 con 0x7f01a8158b10 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.965+0000 7f01a6ffd640 1 -- 172.21.15.26:0/1987319326 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0198014480 con 0x7f01a8158b10 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.965+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a814f8d0 con 0x7f01a8158b10 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.965+0000 7f01a6ffd640 1 -- 172.21.15.26:0/1987319326 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198014850 con 0x7f01a8158b10 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.965+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a80ccf70 con 0x7f01a8158b10 2024-04-25T13:17:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.966+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a8068f50 con 0x7f01a8158b10 2024-04-25T13:17:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.966+0000 7f01a6ffd640 1 -- 172.21.15.26:0/1987319326 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0198005d10 con 0x7f01a8158b10 2024-04-25T13:17:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.967+0000 7f01a6ffd640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f019406c8f0 0x7f019406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.967+0000 7f01a6ffd640 1 -- 172.21.15.26:0/1987319326 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f019808cd60 con 0x7f01a8158b10 2024-04-25T13:17:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.967+0000 7f01ae35b640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f019406c8f0 0x7f019406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.967+0000 7f01ae35b640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f019406c8f0 0x7f019406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01a0034000 tx=0x7f01a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:13.971+0000 7f01a6ffd640 1 -- 172.21.15.26:0/1987319326 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0198022030 con 0x7f01a8158b10 2024-04-25T13:17:14.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.157+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f01a806f770 con 0x7f01a8158b10 2024-04-25T13:17:14.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.157+0000 7f01a6ffd640 1 -- 172.21.15.26:0/1987319326 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f0198010040 con 0x7f01a8158b10 2024-04-25T13:17:14.158 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f019406c8f0 msgr2=0x7f019406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f019406c8f0 0x7f019406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01a0034000 tx=0x7f01a002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a8158b10 msgr2=0x7f01a81544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a8158b10 0x7f01a81544e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0198009dd0 tx=0x7f019800c490 comp rx=0 tx=0).stop 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 shutdown_connections 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f019406c8f0 0x7f019406edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a8158b10 0x7f01a81544e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c8720 0x7f01a815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.159+0000 7f01b05bf640 1 --2- 172.21.15.26:0/1987319326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a80c8340 0x7f01a815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.160+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 >> 172.21.15.26:0/1987319326 conn(0x7f01a806d660 msgr2=0x7f01a8073c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:14.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.160+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 shutdown_connections 2024-04-25T13:17:14.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.160+0000 7f01b05bf640 1 -- 172.21.15.26:0/1987319326 wait complete. 2024-04-25T13:17:14.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.275+0000 7f1b0f035640 1 Processor -- start 2024-04-25T13:17:14.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.275+0000 7f1b0f035640 1 -- start start 2024-04-25T13:17:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0f035640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b08155250 0x7f1b08072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0f035640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b080c5e70 0x7f1b080734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0f035640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b0815bf90 con 0x7f1b080b3840 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0f035640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0815f2d0 con 0x7f1b08155250 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0f035640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0815e6c0 con 0x7f1b080c5e70 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0cdd1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b08155250 0x7f1b08072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0cdd1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b08155250 0x7f1b08072f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53482/0 (socket says 172.21.15.26:53482) 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0cdd1640 1 -- 172.21.15.26:0/173813686 learned_addr learned my addr 172.21.15.26:0/173813686 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.276+0000 7f1b0d5d2640 1 --2- 172.21.15.26:0/173813686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b080c5e70 0x7f1b080734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.277+0000 7f1b0cdd1640 1 -- 172.21.15.26:0/173813686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b080c5e70 msgr2=0x7f1b080734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:14.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.277+0000 7f1b0cdd1640 1 --2- 172.21.15.26:0/173813686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b080c5e70 0x7f1b080734c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.277+0000 7f1b0cdd1640 1 -- 172.21.15.26:0/173813686 >> v1:172.21.15.169:6789/0 conn(0x7f1b080b3840 legacy=0x7f1b080c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.277+0000 7f1b0cdd1640 1 -- 172.21.15.26:0/173813686 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0815e9a0 con 0x7f1b08155250 2024-04-25T13:17:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.277+0000 7f1b0cdd1640 1 --2- 172.21.15.26:0/173813686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b08155250 0x7f1b08072f80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e50 tx=0x7f1b0002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f250d231e6f02325 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b077fe640 1 -- 172.21.15.26:0/173813686 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00036070 con 0x7f1b08155250 2024-04-25T13:17:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b077fe640 1 -- 172.21.15.26:0/173813686 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b00031600 con 0x7f1b08155250 2024-04-25T13:17:14.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b077fe640 1 -- 172.21.15.26:0/173813686 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000319d0 con 0x7f1b08155250 2024-04-25T13:17:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 -- 172.21.15.26:0/173813686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b08155250 msgr2=0x7f1b08072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 --2- 172.21.15.26:0/173813686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b08155250 0x7f1b08072f80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e50 tx=0x7f1b0002a7a0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 -- 172.21.15.26:0/173813686 shutdown_connections 2024-04-25T13:17:14.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 --2- 172.21.15.26:0/173813686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b080c5e70 0x7f1b080734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 --2- 172.21.15.26:0/173813686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b08155250 0x7f1b08072f80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 -- 172.21.15.26:0/173813686 >> 172.21.15.26:0/173813686 conn(0x7f1b080d0a00 msgr2=0x7f1b080d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 -- 172.21.15.26:0/173813686 shutdown_connections 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.278+0000 7f1b0f035640 1 -- 172.21.15.26:0/173813686 wait complete. 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.279+0000 7f1b0f035640 1 Processor -- start 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.279+0000 7f1b0f035640 1 -- start start 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0f035640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b080b3840 0x7f1b081542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0f035640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b08155250 0x7f1b080b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0f035640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b080b32f0 0x7f1b081f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0f035640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0815bb50 con 0x7f1b080b32f0 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0f035640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0815ef60 con 0x7f1b080b3840 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0f035640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0815bcd0 con 0x7f1b08155250 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0d5d2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b080b32f0 0x7f1b081f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0d5d2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b080b32f0 0x7f1b081f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53488/0 (socket says 172.21.15.26:53488) 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.280+0000 7f1b0d5d2640 1 -- 172.21.15.26:0/3507832570 learned_addr learned my addr 172.21.15.26:0/3507832570 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b07fff640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b08155250 0x7f1b080b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0cdd1640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b080b3840 0x7f1b081542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0d5d2640 1 -- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b08155250 msgr2=0x7f1b080b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0d5d2640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b08155250 0x7f1b080b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0d5d2640 1 -- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b080b3840 msgr2=0x7f1b081542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0d5d2640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b080b3840 0x7f1b081542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0d5d2640 1 -- 172.21.15.26:0/3507832570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b08154990 con 0x7f1b080b32f0 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0d5d2640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b080b32f0 0x7f1b081f43b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e7f0 tx=0x7f1af800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b057fa640 1 -- 172.21.15.26:0/3507832570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8017070 con 0x7f1b080b32f0 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b057fa640 1 -- 172.21.15.26:0/3507832570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af800c940 con 0x7f1b080b32f0 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b057fa640 1 -- 172.21.15.26:0/3507832570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af800cd30 con 0x7f1b080b32f0 2024-04-25T13:17:14.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0814dda0 con 0x7f1b080b32f0 2024-04-25T13:17:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.281+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0814e360 con 0x7f1b080b32f0 2024-04-25T13:17:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.282+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b08068e40 con 0x7f1b080b32f0 2024-04-25T13:17:14.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.283+0000 7f1b057fa640 1 -- 172.21.15.26:0/3507832570 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1af801a070 con 0x7f1b080b32f0 2024-04-25T13:17:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.283+0000 7f1b057fa640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1af406c8f0 0x7f1af406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.283+0000 7f1b057fa640 1 -- 172.21.15.26:0/3507832570 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f1af808c1b0 con 0x7f1b080b32f0 2024-04-25T13:17:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.284+0000 7f1b0cdd1640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1af406c8f0 0x7f1af406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.284+0000 7f1b0cdd1640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1af406c8f0 0x7f1af406edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b00033000 tx=0x7f1b00009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.288+0000 7f1b057fa640 1 -- 172.21.15.26:0/3507832570 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1af8059b50 con 0x7f1b080b32f0 2024-04-25T13:17:14.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.472+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1b080cc300 con 0x7f1b080b32f0 2024-04-25T13:17:14.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.472+0000 7f1b057fa640 1 -- 172.21.15.26:0/3507832570 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f1af805de50 con 0x7f1b080b32f0 2024-04-25T13:17:14.473 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:17:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1af406c8f0 msgr2=0x7f1af406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1af406c8f0 0x7f1af406edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b00033000 tx=0x7f1b00009000 comp rx=0 tx=0).stop 2024-04-25T13:17:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b080b32f0 msgr2=0x7f1b081f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b080b32f0 0x7f1b081f43b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e7f0 tx=0x7f1af800ecb0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 shutdown_connections 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1af406c8f0 0x7f1af406edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b080b32f0 0x7f1b081f43b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b08155250 0x7f1b080b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 --2- 172.21.15.26:0/3507832570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b080b3840 0x7f1b081542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 >> 172.21.15.26:0/3507832570 conn(0x7f1b080d0a00 msgr2=0x7f1b080cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 shutdown_connections 2024-04-25T13:17:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.474+0000 7f1b0f035640 1 -- 172.21.15.26:0/3507832570 wait complete. 2024-04-25T13:17:14.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:17:14.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.587+0000 7f1c5d55c640 1 Processor -- start 2024-04-25T13:17:14.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.587+0000 7f1c5d55c640 1 -- start start 2024-04-25T13:17:14.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c5d55c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1c580cb440 0x7f1c580caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c5d55c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c5815cdd0 0x7f1c580cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c5d55c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c580c9bb0 con 0x7f1c580c9fa0 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c5d55c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1c580c5a70 con 0x7f1c5815cdd0 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c5d55c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1c580c5cc0 con 0x7f1c580cb440 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c577fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c5815cdd0 0x7f1c580cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c567fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1c580c9fa0 0x7f1c5815c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34248/0 (socket says 172.21.15.26:34248) 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c567fc640 1 -- 172.21.15.26:0/2363224065 learned_addr learned my addr 172.21.15.26:0/2363224065 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c56ffd640 1 --2- 172.21.15.26:0/2363224065 >> v2:172.21.15.169:3300/0 conn(0x7f1c580cb440 0x7f1c580caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c577fe640 1 -- 172.21.15.26:0/2363224065 >> v2:172.21.15.169:3300/0 conn(0x7f1c580cb440 msgr2=0x7f1c580caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:14.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c577fe640 1 --2- 172.21.15.26:0/2363224065 >> v2:172.21.15.169:3300/0 conn(0x7f1c580cb440 0x7f1c580caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c577fe640 1 -- 172.21.15.26:0/2363224065 >> v1:172.21.15.26:6789/0 conn(0x7f1c580c9fa0 legacy=0x7f1c5815c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c577fe640 1 -- 172.21.15.26:0/2363224065 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c580c5fa0 con 0x7f1c5815cdd0 2024-04-25T13:17:14.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.588+0000 7f1c55ffb640 1 -- 172.21.15.26:0/2363224065 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650723432 0 0) 0x7f1c580c9bb0 con 0x7f1c580c9fa0 2024-04-25T13:17:14.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.589+0000 7f1c577fe640 1 --2- 172.21.15.26:0/2363224065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5815cdd0 0x7f1c580cb820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c580c5bf0 tx=0x7f1c4802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5700dd3917757d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.589+0000 7f1c55ffb640 1 -- 172.21.15.26:0/2363224065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48007740 con 0x7f1c5815cdd0 2024-04-25T13:17:14.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.589+0000 7f1c55ffb640 1 -- 172.21.15.26:0/2363224065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c480078e0 con 0x7f1c5815cdd0 2024-04-25T13:17:14.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.589+0000 7f1c55ffb640 1 -- 172.21.15.26:0/2363224065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48007cb0 con 0x7f1c5815cdd0 2024-04-25T13:17:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 -- 172.21.15.26:0/2363224065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5815cdd0 msgr2=0x7f1c580cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/2363224065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5815cdd0 0x7f1c580cb820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c580c5bf0 tx=0x7f1c4802a6a0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 -- 172.21.15.26:0/2363224065 shutdown_connections 2024-04-25T13:17:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/2363224065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5815cdd0 0x7f1c580cb820 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/2363224065 >> v2:172.21.15.169:3300/0 conn(0x7f1c580cb440 0x7f1c580caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 -- 172.21.15.26:0/2363224065 >> 172.21.15.26:0/2363224065 conn(0x7f1c58074f30 msgr2=0x7f1c58075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 -- 172.21.15.26:0/2363224065 shutdown_connections 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.590+0000 7f1c5d55c640 1 -- 172.21.15.26:0/2363224065 wait complete. 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.591+0000 7f1c5d55c640 1 Processor -- start 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.591+0000 7f1c5d55c640 1 -- start start 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c5d55c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c580c9fa0 0x7f1c5814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c5d55c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c580cb440 0x7f1c5815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c5d55c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c5815cdd0 0x7f1c5814deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c5d55c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1c580c9850 con 0x7f1c580c9fa0 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c5d55c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c580ca720 con 0x7f1c580cb440 2024-04-25T13:17:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c5d55c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c58153360 con 0x7f1c5815cdd0 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c580c9fa0 0x7f1c5814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c580c9fa0 0x7f1c5814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53508/0 (socket says 172.21.15.26:53508) 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 -- 172.21.15.26:0/1689135866 learned_addr learned my addr 172.21.15.26:0/1689135866 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c577fe640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c5815cdd0 0x7f1c5814deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c567fc640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c580cb440 0x7f1c5815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 -- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c5815cdd0 msgr2=0x7f1c5814deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c5815cdd0 0x7f1c5814deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 -- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c580cb440 msgr2=0x7f1c5815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c580cb440 0x7f1c5815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.592+0000 7f1c56ffd640 1 -- 172.21.15.26:0/1689135866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5814a790 con 0x7f1c580c9fa0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.593+0000 7f1c56ffd640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c580c9fa0 0x7f1c5814a080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d800 tx=0x7f1c5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.593+0000 7f1c4f7fe640 1 -- 172.21.15.26:0/1689135866 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000b6c0 con 0x7f1c580c9fa0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.593+0000 7f1c4f7fe640 1 -- 172.21.15.26:0/1689135866 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c50019070 con 0x7f1c580c9fa0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.593+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5814c120 con 0x7f1c580c9fa0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.593+0000 7f1c4f7fe640 1 -- 172.21.15.26:0/1689135866 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000ba80 con 0x7f1c580c9fa0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.593+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5814c6e0 con 0x7f1c580c9fa0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.594+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c580c81e0 con 0x7f1c580c9fa0 2024-04-25T13:17:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.594+0000 7f1c4f7fe640 1 -- 172.21.15.26:0/1689135866 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c5000bc20 con 0x7f1c580c9fa0 2024-04-25T13:17:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.594+0000 7f1c4f7fe640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c3806c920 0x7f1c3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.595+0000 7f1c4f7fe640 1 -- 172.21.15.26:0/1689135866 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f1c5008c460 con 0x7f1c580c9fa0 2024-04-25T13:17:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.595+0000 7f1c567fc640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c3806c920 0x7f1c3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.595+0000 7f1c567fc640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c3806c920 0x7f1c3806ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1c58075760 tx=0x7f1c40007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.599+0000 7f1c4f7fe640 1 -- 172.21.15.26:0/1689135866 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c580c81e0 con 0x7f1c580c9fa0 2024-04-25T13:17:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.798+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1c58068e40 con 0x7f1c580c9fa0 2024-04-25T13:17:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.798+0000 7f1c4f7fe640 1 -- 172.21.15.26:0/1689135866 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f1c5005a450 con 0x7f1c580c9fa0 2024-04-25T13:17:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-25T13:17:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c3806c920 msgr2=0x7f1c3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c3806c920 0x7f1c3806ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1c58075760 tx=0x7f1c40007b50 comp rx=0 tx=0).stop 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c580c9fa0 msgr2=0x7f1c5814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c580c9fa0 0x7f1c5814a080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d800 tx=0x7f1c5000dcc0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 shutdown_connections 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f1c3806c920 0x7f1c3806ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c5815cdd0 0x7f1c5814deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c580cb440 0x7f1c5815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 --2- 172.21.15.26:0/1689135866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c580c9fa0 0x7f1c5814a080 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 >> 172.21.15.26:0/1689135866 conn(0x7f1c58074f30 msgr2=0x7f1c58151110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 shutdown_connections 2024-04-25T13:17:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.800+0000 7f1c5d55c640 1 -- 172.21.15.26:0/1689135866 wait complete. 2024-04-25T13:17:14.811 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-25T13:17:14.811 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:14.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.968+0000 7ffb3ebad640 1 Processor -- start 2024-04-25T13:17:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.968+0000 7ffb3ebad640 1 -- start start 2024-04-25T13:17:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3ebad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb38074d50 0x7ffb3815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3ebad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb3815f190 0x7ffb380c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3ebad640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffb38075130 0x7ffb38075560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3ebad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ffb380cdcb0 con 0x7ffb38074d50 2024-04-25T13:17:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3ebad640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ffb380c93b0 con 0x7ffb38075130 2024-04-25T13:17:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3ebad640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffb38075aa0 con 0x7ffb3815f190 2024-04-25T13:17:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb38074d50 0x7ffb3815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb38074d50 0x7ffb3815b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53512/0 (socket says 172.21.15.26:53512) 2024-04-25T13:17:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 -- 172.21.15.26:0/4052432263 learned_addr learned my addr 172.21.15.26:0/4052432263 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb37fff640 1 --2- 172.21.15.26:0/4052432263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb3815f190 0x7ffb380c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3d14a640 1 --2- 172.21.15.26:0/4052432263 >> v2:172.21.15.169:3300/0 conn(0x7ffb38075130 0x7ffb38075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 -- 172.21.15.26:0/4052432263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb3815f190 msgr2=0x7ffb380c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 --2- 172.21.15.26:0/4052432263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb3815f190 0x7ffb380c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 -- 172.21.15.26:0/4052432263 >> v2:172.21.15.169:3300/0 conn(0x7ffb38075130 msgr2=0x7ffb38075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 --2- 172.21.15.26:0/4052432263 >> v2:172.21.15.169:3300/0 conn(0x7ffb38075130 0x7ffb38075560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3c949640 1 -- 172.21.15.26:0/4052432263 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb380cdf70 con 0x7ffb38074d50 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.969+0000 7ffb3d14a640 1 --2- 172.21.15.26:0/4052432263 >> v2:172.21.15.169:3300/0 conn(0x7ffb38075130 0x7ffb38075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.970+0000 7ffb3c949640 1 --2- 172.21.15.26:0/4052432263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb38074d50 0x7ffb3815b9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806f400 tx=0x7ffb2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfd0456d05d8d93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.970+0000 7ffb377fe640 1 -- 172.21.15.26:0/4052432263 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c037070 con 0x7ffb38074d50 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.970+0000 7ffb377fe640 1 -- 172.21.15.26:0/4052432263 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c032440 con 0x7ffb38074d50 2024-04-25T13:17:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.970+0000 7ffb377fe640 1 -- 172.21.15.26:0/4052432263 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c032810 con 0x7ffb38074d50 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.970+0000 7ffb3ebad640 1 -- 172.21.15.26:0/4052432263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb38074d50 msgr2=0x7ffb3815b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/4052432263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb38074d50 0x7ffb3815b9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806f400 tx=0x7ffb2c02a270 comp rx=0 tx=0).stop 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 -- 172.21.15.26:0/4052432263 shutdown_connections 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/4052432263 >> v2:172.21.15.169:3300/0 conn(0x7ffb38075130 0x7ffb38075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/4052432263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb3815f190 0x7ffb380c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/4052432263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb38074d50 0x7ffb3815b9a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 -- 172.21.15.26:0/4052432263 >> 172.21.15.26:0/4052432263 conn(0x7ffb3806b920 msgr2=0x7ffb3806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 -- 172.21.15.26:0/4052432263 shutdown_connections 2024-04-25T13:17:14.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.971+0000 7ffb3ebad640 1 -- 172.21.15.26:0/4052432263 wait complete. 2024-04-25T13:17:14.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.972+0000 7ffb3ebad640 1 Processor -- start 2024-04-25T13:17:14.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.972+0000 7ffb3ebad640 1 -- start start 2024-04-25T13:17:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb38074d50 0x7ffb38141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb38075130 0x7ffb3815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb3815f190 0x7ffb381f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3815e990 con 0x7ffb3815f190 2024-04-25T13:17:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3815e6b0 con 0x7ffb38074d50 2024-04-25T13:17:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3815ec70 con 0x7ffb38075130 2024-04-25T13:17:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb3815f190 0x7ffb381f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb3815f190 0x7ffb381f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53516/0 (socket says 172.21.15.26:53516) 2024-04-25T13:17:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 -- 172.21.15.26:0/3726402407 learned_addr learned my addr 172.21.15.26:0/3726402407 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb37fff640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb38075130 0x7ffb3815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3c949640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb38074d50 0x7ffb38141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 -- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb38075130 msgr2=0x7ffb3815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb38075130 0x7ffb3815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 -- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb38074d50 msgr2=0x7ffb38141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb38074d50 0x7ffb38141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 -- 172.21.15.26:0/3726402407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3813d9e0 con 0x7ffb3815f190 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3d14a640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb3815f190 0x7ffb381f0fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007db0 tx=0x7ffb3000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb357fa640 1 -- 172.21.15.26:0/3726402407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3001a070 con 0x7ffb3815f190 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb357fa640 1 -- 172.21.15.26:0/3726402407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb30003990 con 0x7ffb3815f190 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb357fa640 1 -- 172.21.15.26:0/3726402407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30003d60 con 0x7ffb3815f190 2024-04-25T13:17:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb38158b30 con 0x7ffb3815f190 2024-04-25T13:17:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.973+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb381f4fc0 con 0x7ffb3815f190 2024-04-25T13:17:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.974+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb380741e0 con 0x7ffb3815f190 2024-04-25T13:17:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.975+0000 7ffb357fa640 1 -- 172.21.15.26:0/3726402407 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb3001d070 con 0x7ffb3815f190 2024-04-25T13:17:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.975+0000 7ffb357fa640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffb1c06c8f0 0x7ffb1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.975+0000 7ffb357fa640 1 -- 172.21.15.26:0/3726402407 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7ffb3008c1a0 con 0x7ffb3815f190 2024-04-25T13:17:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.976+0000 7ffb3c949640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffb1c06c8f0 0x7ffb1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.976+0000 7ffb3c949640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffb1c06c8f0 0x7ffb1c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c034000 tx=0x7ffb2c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:14.980+0000 7ffb357fa640 1 -- 172.21.15.26:0/3726402407 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb380741e0 con 0x7ffb3815f190 2024-04-25T13:17:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.165+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb38068e40 con 0x7ffb3815f190 2024-04-25T13:17:15.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.166+0000 7ffb357fa640 1 -- 172.21.15.26:0/3726402407 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18947 (secure 0 0 0) 0x7ffb30010070 con 0x7ffb3815f190 2024-04-25T13:17:15.166 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:15.166 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:50.350764+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffb1c06c8f0 msgr2=0x7ffb1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffb1c06c8f0 0x7ffb1c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c034000 tx=0x7ffb2c02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb3815f190 msgr2=0x7ffb381f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb3815f190 0x7ffb381f0fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007db0 tx=0x7ffb3000d4a0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 shutdown_connections 2024-04-25T13:17:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7ffb1c06c8f0 0x7ffb1c06edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb3815f190 0x7ffb381f0fa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb38075130 0x7ffb3815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 --2- 172.21.15.26:0/3726402407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb38074d50 0x7ffb38141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 >> 172.21.15.26:0/3726402407 conn(0x7ffb3806b920 msgr2=0x7ffb38143360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 shutdown_connections 2024-04-25T13:17:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.168+0000 7ffb3ebad640 1 -- 172.21.15.26:0/3726402407 wait complete. 2024-04-25T13:17:15.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.175636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:07.306201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:08.537870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:12.230813+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:15.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.283+0000 7f96dadd8640 1 Processor -- start 2024-04-25T13:17:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.283+0000 7f96dadd8640 1 -- start start 2024-04-25T13:17:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.284+0000 7f96dadd8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f96d40b3600 0x7f96d40cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.284+0000 7f96dadd8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d415be60 con 0x7f96d40cdda0 2024-04-25T13:17:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.284+0000 7f96dadd8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d415e650 con 0x7f96d4154f00 2024-04-25T13:17:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.284+0000 7f96dadd8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f96d415e930 con 0x7f96d40b3600 2024-04-25T13:17:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.284+0000 7f96d9375640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f96d40cdda0 0x7f96d4165940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34254/0 (socket says 172.21.15.26:34254) 2024-04-25T13:17:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.284+0000 7f96d9375640 1 -- 172.21.15.26:0/1140604829 learned_addr learned my addr 172.21.15.26:0/1140604829 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.284+0000 7f96d3fff640 1 --2- 172.21.15.26:0/1140604829 >> v2:172.21.15.169:3300/0 conn(0x7f96d40b3600 0x7f96d40cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121645839 0 0) 0x7f96d415be60 con 0x7f96d40cdda0 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96c0003520 con 0x7f96d40cdda0 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1974033800 0 0) 0x7f96c0003520 con 0x7f96d40cdda0 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 >> v2:172.21.15.169:3300/0 conn(0x7f96d40b3600 msgr2=0x7f96d40cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 --2- 172.21.15.26:0/1140604829 >> v2:172.21.15.169:3300/0 conn(0x7f96d40b3600 0x7f96d40cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 >> v1:172.21.15.169:6789/0 conn(0x7f96d4154f00 legacy=0x7f96d4073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d415ec10 con 0x7f96d40cdda0 2024-04-25T13:17:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f96c4001670 con 0x7f96d40cdda0 2024-04-25T13:17:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 >> v1:172.21.15.26:6789/0 conn(0x7f96d40cdda0 legacy=0x7f96d4165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96c00039b0 0x7f96c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c0004800 0x7f96c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c00051c0 0x7f96c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f96d415e930 con 0x7f96c0004800 2024-04-25T13:17:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96c000c060 con 0x7f96c00051c0 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f96c000c260 con 0x7f96c00039b0 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d3fff640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c0004800 0x7f96c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d9375640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c00051c0 0x7f96c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d8b74640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96c00039b0 0x7f96c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d3fff640 1 -- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96c00039b0 msgr2=0x7f96c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d3fff640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96c00039b0 0x7f96c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d3fff640 1 -- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c00051c0 msgr2=0x7f96c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d3fff640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c00051c0 0x7f96c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d3fff640 1 -- 172.21.15.26:0/1140604829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c0003520 con 0x7f96c0004800 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d8b74640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96c00039b0 0x7f96c0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d9375640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c00051c0 0x7f96c000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.285+0000 7f96d9375640 1 -- 172.21.15.26:0/1140604829 reap_dead start 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.286+0000 7f96d3fff640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c0004800 0x7f96c0004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009ac0 tx=0x7f96c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d076bfb90683ecf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.286+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc036070 con 0x7f96c0004800 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.286+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96bc031400 con 0x7f96c0004800 2024-04-25T13:17:15.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.286+0000 7f96d37fe640 1 -- 172.21.15.26:0/1140604829 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc009690 con 0x7f96c0004800 2024-04-25T13:17:15.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.287+0000 7f96dadd8640 1 -- 172.21.15.26:0/1140604829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c0004800 msgr2=0x7f96c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.287+0000 7f96dadd8640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c0004800 0x7f96c0004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009ac0 tx=0x7f96c0005830 comp rx=0 tx=0).stop 2024-04-25T13:17:15.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.287+0000 7f96dadd8640 1 -- 172.21.15.26:0/1140604829 shutdown_connections 2024-04-25T13:17:15.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.287+0000 7f96dadd8640 1 --2- 172.21.15.26:0/1140604829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c0004800 0x7f96c0004c80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.287+0000 7f96dadd8640 1 -- 172.21.15.26:0/1140604829 >> 172.21.15.26:0/1140604829 conn(0x7f96d4068570 msgr2=0x7f96d4071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.287+0000 7f96dadd8640 1 -- 172.21.15.26:0/1140604829 shutdown_connections 2024-04-25T13:17:15.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.287+0000 7f96dadd8640 1 -- 172.21.15.26:0/1140604829 wait complete. 2024-04-25T13:17:15.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.288+0000 7f96dadd8640 1 Processor -- start 2024-04-25T13:17:15.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.288+0000 7f96dadd8640 1 -- start start 2024-04-25T13:17:15.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96dadd8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c0004800 0x7f96d40b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96dadd8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96d40b59a0 0x7f96d41e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96dadd8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96d415c5a0 0x7f96d40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96dadd8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41552e0 con 0x7f96d415c5a0 2024-04-25T13:17:15.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96dadd8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96d40cb230 con 0x7f96c0004800 2024-04-25T13:17:15.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96dadd8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f96d41f1a30 con 0x7f96d40b59a0 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96d415c5a0 0x7f96d40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96d415c5a0 0x7f96d40b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53524/0 (socket says 172.21.15.26:53524) 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 -- 172.21.15.26:0/3822786852 learned_addr learned my addr 172.21.15.26:0/3822786852 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d8b74640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c0004800 0x7f96d40b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d3fff640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96d40b59a0 0x7f96d41e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 -- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96d40b59a0 msgr2=0x7f96d41e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96d40b59a0 0x7f96d41e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 -- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c0004800 msgr2=0x7f96d40b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c0004800 0x7f96d40b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 -- 172.21.15.26:0/3822786852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d41f1f40 con 0x7f96d415c5a0 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d3fff640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96d40b59a0 0x7f96d41e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d9375640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96d415c5a0 0x7f96d40b3ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f96d4073c90 tx=0x7f96c400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.289+0000 7f96d17fa640 1 -- 172.21.15.26:0/3822786852 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4010510 con 0x7f96d415c5a0 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.290+0000 7f96d17fa640 1 -- 172.21.15.26:0/3822786852 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c40106b0 con 0x7f96d415c5a0 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.290+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d41f1c60 con 0x7f96d415c5a0 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.290+0000 7f96d17fa640 1 -- 172.21.15.26:0/3822786852 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4010a80 con 0x7f96d415c5a0 2024-04-25T13:17:15.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.290+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d415df70 con 0x7f96d415c5a0 2024-04-25T13:17:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.290+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d4068f50 con 0x7f96d415c5a0 2024-04-25T13:17:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.291+0000 7f96d17fa640 1 -- 172.21.15.26:0/3822786852 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96c401b020 con 0x7f96d415c5a0 2024-04-25T13:17:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.291+0000 7f96d17fa640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f96b406c920 0x7f96b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.292+0000 7f96d17fa640 1 -- 172.21.15.26:0/3822786852 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f96c408b510 con 0x7f96d415c5a0 2024-04-25T13:17:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.292+0000 7f96d8b74640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f96b406c920 0x7f96b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.292+0000 7f96d8b74640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f96b406c920 0x7f96b406ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96d40515e0 tx=0x7f96cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.296+0000 7f96d17fa640 1 -- 172.21.15.26:0/3822786852 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96c4059590 con 0x7f96d415c5a0 2024-04-25T13:17:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.478+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96d40b3c50 con 0x7f96d415c5a0 2024-04-25T13:17:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.479+0000 7f96d17fa640 1 -- 172.21.15.26:0/3822786852 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f96c4058e90 con 0x7f96d415c5a0 2024-04-25T13:17:15.479 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-25T13:17:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f96b406c920 msgr2=0x7f96b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f96b406c920 0x7f96b406ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96d40515e0 tx=0x7f96cc009040 comp rx=0 tx=0).stop 2024-04-25T13:17:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96d415c5a0 msgr2=0x7f96d40b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96d415c5a0 0x7f96d40b3ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f96d4073c90 tx=0x7f96c400ead0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 shutdown_connections 2024-04-25T13:17:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f96b406c920 0x7f96b406ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96d415c5a0 0x7f96d40b3ef0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96d40b59a0 0x7f96d41e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 --2- 172.21.15.26:0/3822786852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96c0004800 0x7f96d40b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 >> 172.21.15.26:0/3822786852 conn(0x7f96d4068570 msgr2=0x7f96d4159130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 shutdown_connections 2024-04-25T13:17:15.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.481+0000 7f96dadd8640 1 -- 172.21.15.26:0/3822786852 wait complete. 2024-04-25T13:17:15.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:15.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.596+0000 7f86b4efd640 1 Processor -- start 2024-04-25T13:17:15.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.596+0000 7f86b4efd640 1 -- start start 2024-04-25T13:17:15.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.596+0000 7f86b4efd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 0x7f86b0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.596+0000 7f86b4efd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f86b00c8cb0 0x7f86b015b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.596+0000 7f86b4efd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b0157f40 con 0x7f86b00c8860 2024-04-25T13:17:15.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.596+0000 7f86b4efd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f86b00c90b0 con 0x7f86b00c8cb0 2024-04-25T13:17:15.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.596+0000 7f86b4efd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86b0158b30 con 0x7f86b0151ea0 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86a7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f86b00c8860 0x7f86b00ca560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34262/0 (socket says 172.21.15.26:34262) 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86a7fff640 1 -- 172.21.15.26:0/3354382085 learned_addr learned my addr 172.21.15.26:0/3354382085 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86aed9d640 1 --2- 172.21.15.26:0/3354382085 >> v2:172.21.15.169:3300/0 conn(0x7f86b00c8cb0 0x7f86b015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86ae59c640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 0x7f86b0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384863417 0 0) 0x7f86b0157f40 con 0x7f86b00c8860 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f869c003520 con 0x7f86b00c8860 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867500368 0 0) 0x7f869c003520 con 0x7f86b00c8860 2024-04-25T13:17:15.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 msgr2=0x7f86b0072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 0x7f86b0072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 >> v2:172.21.15.169:3300/0 conn(0x7f86b00c8cb0 msgr2=0x7f86b015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 --2- 172.21.15.26:0/3354382085 >> v2:172.21.15.169:3300/0 conn(0x7f86b00c8cb0 0x7f86b015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b0158200 con 0x7f86b00c8860 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f8698001670 con 0x7f86b00c8860 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86aed9d640 1 --2- 172.21.15.26:0/3354382085 >> v2:172.21.15.169:3300/0 conn(0x7f86b00c8cb0 0x7f86b015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 >> v1:172.21.15.26:6789/0 conn(0x7f86b00c8860 legacy=0x7f86b00ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c0039b0 0x7f869c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 0x7f869c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f869c004d40 0x7f869c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f86b00c90b0 con 0x7f869c004d40 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86b0158b30 con 0x7f869c0039b0 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f869c00dbd0 con 0x7f86b0151ea0 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86aed9d640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f869c004d40 0x7f869c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86a7fff640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 0x7f869c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.597+0000 7f86ae59c640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c0039b0 0x7f869c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86aed9d640 1 -- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 msgr2=0x7f869c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86aed9d640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b0151ea0 0x7f869c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86aed9d640 1 -- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c0039b0 msgr2=0x7f869c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86aed9d640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c0039b0 0x7f869c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86aed9d640 1 -- 172.21.15.26:0/3354382085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c003520 con 0x7f869c004d40 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86aed9d640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f869c004d40 0x7f869c0051c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f86a800e350 tx=0x7f869c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d399b340d35c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8009de0 con 0x7f869c004d40 2024-04-25T13:17:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a802e660 con 0x7f869c004d40 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.598+0000 7f86add9b640 1 -- 172.21.15.26:0/3354382085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a802ea10 con 0x7f869c004d40 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.599+0000 7f86b4efd640 1 -- 172.21.15.26:0/3354382085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f869c004d40 msgr2=0x7f869c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.599+0000 7f86b4efd640 1 --2- 172.21.15.26:0/3354382085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f869c004d40 0x7f869c0051c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f86a800e350 tx=0x7f869c005830 comp rx=0 tx=0).stop 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.599+0000 7f86aed9d640 1 -- 172.21.15.26:0/3354382085 reap_dead start 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.599+0000 7f86b4efd640 1 -- 172.21.15.26:0/3354382085 shutdown_connections 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.599+0000 7f86b4efd640 1 -- 172.21.15.26:0/3354382085 >> 172.21.15.26:0/3354382085 conn(0x7f86b006bd10 msgr2=0x7f86b006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.599+0000 7f86b4efd640 1 -- 172.21.15.26:0/3354382085 shutdown_connections 2024-04-25T13:17:15.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.599+0000 7f86b4efd640 1 -- 172.21.15.26:0/3354382085 wait complete. 2024-04-25T13:17:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.600+0000 7f86b4efd640 1 Processor -- start 2024-04-25T13:17:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.600+0000 7f86b4efd640 1 -- start start 2024-04-25T13:17:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86b4efd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c004d40 0x7f86b01ec670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86b4efd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b01efbe0 0x7f86b0145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86b4efd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b0157060 0x7f86b0142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86b4efd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f86b00cac70 con 0x7f86b0157060 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86b4efd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01587c0 con 0x7f869c004d40 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86b4efd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86b00cadf0 con 0x7f86b01efbe0 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b0157060 0x7f86b0142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b0157060 0x7f86b0142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53546/0 (socket says 172.21.15.26:53546) 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 -- 172.21.15.26:0/2173225930 learned_addr learned my addr 172.21.15.26:0/2173225930 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86a7fff640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b01efbe0 0x7f86b0145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 -- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b01efbe0 msgr2=0x7f86b0145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b01efbe0 0x7f86b0145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 -- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c004d40 msgr2=0x7f86b01ec670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c004d40 0x7f86b01ec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86aed9d640 1 -- 172.21.15.26:0/2173225930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b01565f0 con 0x7f86b0157060 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.601+0000 7f86a7fff640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b01efbe0 0x7f86b0145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.602+0000 7f86aed9d640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b0157060 0x7f86b0142df0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f86a8002230 tx=0x7f86a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.602+0000 7f86a6ffd640 1 -- 172.21.15.26:0/2173225930 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8009de0 con 0x7f86b0157060 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.602+0000 7f86a6ffd640 1 -- 172.21.15.26:0/2173225930 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a8003990 con 0x7f86b0157060 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.602+0000 7f86a6ffd640 1 -- 172.21.15.26:0/2173225930 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8003d60 con 0x7f86b0157060 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.602+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b01ece90 con 0x7f86b0157060 2024-04-25T13:17:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.602+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b01ed450 con 0x7f86b0157060 2024-04-25T13:17:15.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.603+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b0068e40 con 0x7f86b0157060 2024-04-25T13:17:15.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.603+0000 7f86a6ffd640 1 -- 172.21.15.26:0/2173225930 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86a80368c0 con 0x7f86b0157060 2024-04-25T13:17:15.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.604+0000 7f86a6ffd640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f869006c8f0 0x7f869006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.604+0000 7f86a6ffd640 1 -- 172.21.15.26:0/2173225930 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f86a80ad0e0 con 0x7f86b0157060 2024-04-25T13:17:15.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.604+0000 7f86ae59c640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f869006c8f0 0x7f869006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.605+0000 7f86ae59c640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f869006c8f0 0x7f869006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009a40 tx=0x7f86a0009320 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.608+0000 7f86a6ffd640 1 -- 172.21.15.26:0/2173225930 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86a8032030 con 0x7f86b0157060 2024-04-25T13:17:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.793+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f86b00c9410 con 0x7f86b0157060 2024-04-25T13:17:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.794+0000 7f86a6ffd640 1 -- 172.21.15.26:0/2173225930 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f86a807b040 con 0x7f86b0157060 2024-04-25T13:17:15.794 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:17:15.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f869006c8f0 msgr2=0x7f869006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f869006c8f0 0x7f869006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009a40 tx=0x7f86a0009320 comp rx=0 tx=0).stop 2024-04-25T13:17:15.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b0157060 msgr2=0x7f86b0142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b0157060 0x7f86b0142df0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f86a8002230 tx=0x7f86a8004ab0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 shutdown_connections 2024-04-25T13:17:15.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f869006c8f0 0x7f869006edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b0157060 0x7f86b0142df0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86b01efbe0 0x7f86b0145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 --2- 172.21.15.26:0/2173225930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f869c004d40 0x7f86b01ec670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 >> 172.21.15.26:0/2173225930 conn(0x7f86b006bd10 msgr2=0x7f86b0072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 shutdown_connections 2024-04-25T13:17:15.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.796+0000 7f86b4efd640 1 -- 172.21.15.26:0/2173225930 wait complete. 2024-04-25T13:17:15.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:15.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.911+0000 7fe562405640 1 Processor -- start 2024-04-25T13:17:15.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.911+0000 7fe562405640 1 -- start start 2024-04-25T13:17:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe562405640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe55c144220 0x7fe55c15f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe562405640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c0cba10 con 0x7fe55c0cdcf0 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe562405640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c072460 con 0x7fe55c15b2c0 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe562405640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c073070 con 0x7fe55c144220 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe55c0cdcf0 0x7fe55c0c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34270/0 (socket says 172.21.15.26:34270) 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55b7fe640 1 -- 172.21.15.26:0/3959438228 learned_addr learned my addr 172.21.15.26:0/3959438228 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55bfff640 1 --2- 172.21.15.26:0/3959438228 >> v2:172.21.15.169:3300/0 conn(0x7fe55c144220 0x7fe55c15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55affd640 1 -- 172.21.15.26:0/3959438228 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545152489 0 0) 0x7fe55c0cba10 con 0x7fe55c0cdcf0 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55affd640 1 -- 172.21.15.26:0/3959438228 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe548003520 con 0x7fe55c0cdcf0 2024-04-25T13:17:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55bfff640 1 -- 172.21.15.26:0/3959438228 >> v1:172.21.15.169:6789/0 conn(0x7fe55c15b2c0 legacy=0x7fe55c15b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55bfff640 1 -- 172.21.15.26:0/3959438228 >> v1:172.21.15.26:6789/0 conn(0x7fe55c0cdcf0 legacy=0x7fe55c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.912+0000 7fe55bfff640 1 -- 172.21.15.26:0/3959438228 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c072740 con 0x7fe55c144220 2024-04-25T13:17:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.913+0000 7fe55bfff640 1 --2- 172.21.15.26:0/3959438228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c144220 0x7fe55c15f020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5440097d0 tx=0x7fe54402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e74eadd41fcb46d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.913+0000 7fe55affd640 1 -- 172.21.15.26:0/3959438228 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544037070 con 0x7fe55c144220 2024-04-25T13:17:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.913+0000 7fe55affd640 1 -- 172.21.15.26:0/3959438228 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe544032640 con 0x7fe55c144220 2024-04-25T13:17:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.913+0000 7fe55affd640 1 -- 172.21.15.26:0/3959438228 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5440329f0 con 0x7fe55c144220 2024-04-25T13:17:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.914+0000 7fe562405640 1 -- 172.21.15.26:0/3959438228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c144220 msgr2=0x7fe55c15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.914+0000 7fe562405640 1 --2- 172.21.15.26:0/3959438228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c144220 0x7fe55c15f020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5440097d0 tx=0x7fe54402a300 comp rx=0 tx=0).stop 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.914+0000 7fe562405640 1 -- 172.21.15.26:0/3959438228 shutdown_connections 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.914+0000 7fe562405640 1 --2- 172.21.15.26:0/3959438228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c144220 0x7fe55c15f020 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.914+0000 7fe562405640 1 -- 172.21.15.26:0/3959438228 >> 172.21.15.26:0/3959438228 conn(0x7fe55c06b920 msgr2=0x7fe55c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.914+0000 7fe562405640 1 -- 172.21.15.26:0/3959438228 shutdown_connections 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.914+0000 7fe562405640 1 -- 172.21.15.26:0/3959438228 wait complete. 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.915+0000 7fe562405640 1 Processor -- start 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.915+0000 7fe562405640 1 -- start start 2024-04-25T13:17:15.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe562405640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe55c0cdcf0 0x7fe55c1e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe562405640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c144220 0x7fe55c157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe562405640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c15b2c0 0x7fe55c15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe562405640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c0ce140 con 0x7fe55c144220 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe562405640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c072d00 con 0x7fe55c15b2c0 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe562405640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c0ca6c0 con 0x7fe55c0cdcf0 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c144220 0x7fe55c157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c144220 0x7fe55c157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53548/0 (socket says 172.21.15.26:53548) 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 -- 172.21.15.26:0/1481837123 learned_addr learned my addr 172.21.15.26:0/1481837123 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:15.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55bfff640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe55c0cdcf0 0x7fe55c1e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe5609a2640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c15b2c0 0x7fe55c15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 -- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe55c0cdcf0 msgr2=0x7fe55c1e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe55c0cdcf0 0x7fe55c1e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 -- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c15b2c0 msgr2=0x7fe55c15ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c15b2c0 0x7fe55c15ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 -- 172.21.15.26:0/1481837123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c157190 con 0x7fe55c144220 2024-04-25T13:17:15.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.916+0000 7fe55b7fe640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c144220 0x7fe55c157890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c440 tx=0x7fe54c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.917+0000 7fe558ff9640 1 -- 172.21.15.26:0/1481837123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c017070 con 0x7fe55c144220 2024-04-25T13:17:15.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.917+0000 7fe558ff9640 1 -- 172.21.15.26:0/1481837123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c005ce0 con 0x7fe55c144220 2024-04-25T13:17:15.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.917+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c15e330 con 0x7fe55c144220 2024-04-25T13:17:15.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.917+0000 7fe558ff9640 1 -- 172.21.15.26:0/1481837123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0072b0 con 0x7fe55c144220 2024-04-25T13:17:15.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.917+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c15e8f0 con 0x7fe55c144220 2024-04-25T13:17:15.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.918+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55c15eb30 con 0x7fe55c144220 2024-04-25T13:17:15.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.918+0000 7fe558ff9640 1 -- 172.21.15.26:0/1481837123 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe54c01a070 con 0x7fe55c144220 2024-04-25T13:17:15.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.919+0000 7fe558ff9640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe53c06c920 0x7fe53c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.919+0000 7fe558ff9640 1 -- 172.21.15.26:0/1481837123 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fe54c08b2f0 con 0x7fe55c144220 2024-04-25T13:17:15.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.919+0000 7fe55bfff640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe53c06c920 0x7fe53c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.919+0000 7fe55bfff640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe53c06c920 0x7fe53c06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe544034000 tx=0x7fe54402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:15.923+0000 7fe558ff9640 1 -- 172.21.15.26:0/1481837123 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe55c15eb30 con 0x7fe55c144220 2024-04-25T13:17:16.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.110+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe55c068f50 con 0x7fe55c144220 2024-04-25T13:17:16.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.110+0000 7fe558ff9640 1 -- 172.21.15.26:0/1481837123 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fe54c058c40 con 0x7fe55c144220 2024-04-25T13:17:16.111 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-25T13:17:16.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe53c06c920 msgr2=0x7fe53c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe53c06c920 0x7fe53c06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe544034000 tx=0x7fe54402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c144220 msgr2=0x7fe55c157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c144220 0x7fe55c157890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c440 tx=0x7fe54c00c900 comp rx=0 tx=0).stop 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 shutdown_connections 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fe53c06c920 0x7fe53c06ede0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe55c15b2c0 0x7fe55c15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c144220 0x7fe55c157890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 --2- 172.21.15.26:0/1481837123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe55c0cdcf0 0x7fe55c1e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 >> 172.21.15.26:0/1481837123 conn(0x7fe55c06b920 msgr2=0x7fe55c0cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 shutdown_connections 2024-04-25T13:17:16.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.112+0000 7fe562405640 1 -- 172.21.15.26:0/1481837123 wait complete. 2024-04-25T13:17:16.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:16.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 Processor -- start 2024-04-25T13:17:16.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 -- start start 2024-04-25T13:17:16.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b68155250 0x7f5b68072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5b680b3840 0x7f5b680734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b680ccd30 0x7f5b680c5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6815f2d0 con 0x7f5b680ccd30 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6815bf90 con 0x7f5b680b3840 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.227+0000 7f5b6e6ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6815e6c0 con 0x7f5b68155250 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b680ccd30 0x7f5b680c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b680ccd30 0x7f5b680c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53552/0 (socket says 172.21.15.26:53552) 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/4205365336 learned_addr learned my addr 172.21.15.26:0/4205365336 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:16.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b677fe640 1 --2- 172.21.15.26:0/4205365336 >> v2:172.21.15.169:3300/0 conn(0x7f5b680b3840 0x7f5b680734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b67fff640 1 --2- 172.21.15.26:0/4205365336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b68155250 0x7f5b68072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/4205365336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b68155250 msgr2=0x7f5b68072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 --2- 172.21.15.26:0/4205365336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b68155250 0x7f5b68072f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/4205365336 >> v2:172.21.15.169:3300/0 conn(0x7f5b680b3840 msgr2=0x7f5b680734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 --2- 172.21.15.26:0/4205365336 >> v2:172.21.15.169:3300/0 conn(0x7f5b680b3840 0x7f5b680734c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/4205365336 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6815e9a0 con 0x7f5b680ccd30 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.228+0000 7f5b677fe640 1 --2- 172.21.15.26:0/4205365336 >> v2:172.21.15.169:3300/0 conn(0x7f5b680b3840 0x7f5b680734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:16.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6cc4b640 1 --2- 172.21.15.26:0/4205365336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b680ccd30 0x7f5b680c5760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5b6808e6f0 tx=0x7f5b6002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9264a164cfafb7e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b66ffd640 1 -- 172.21.15.26:0/4205365336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60036070 con 0x7f5b680ccd30 2024-04-25T13:17:16.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b66ffd640 1 -- 172.21.15.26:0/4205365336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60031600 con 0x7f5b680ccd30 2024-04-25T13:17:16.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b66ffd640 1 -- 172.21.15.26:0/4205365336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600319d0 con 0x7f5b680ccd30 2024-04-25T13:17:16.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/4205365336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b680ccd30 msgr2=0x7f5b680c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/4205365336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b680ccd30 0x7f5b680c5760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5b6808e6f0 tx=0x7f5b6002a730 comp rx=0 tx=0).stop 2024-04-25T13:17:16.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/4205365336 shutdown_connections 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/4205365336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b680ccd30 0x7f5b680c5760 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/4205365336 >> v2:172.21.15.169:3300/0 conn(0x7f5b680b3840 0x7f5b680734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/4205365336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b68155250 0x7f5b68072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/4205365336 >> 172.21.15.26:0/4205365336 conn(0x7f5b680d0a00 msgr2=0x7f5b680d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/4205365336 shutdown_connections 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.229+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/4205365336 wait complete. 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.230+0000 7f5b6e6ae640 1 Processor -- start 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6e6ae640 1 -- start start 2024-04-25T13:17:16.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6e6ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680b3840 0x7f5b6814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6e6ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680ccd30 0x7f5b68158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6e6ae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68155250 0x7f5b680c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6e6ae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6815bb50 con 0x7f5b68155250 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6e6ae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6815ef60 con 0x7f5b680b3840 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6e6ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6815bcd0 con 0x7f5b680ccd30 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6cc4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68155250 0x7f5b680c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6cc4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68155250 0x7f5b680c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53564/0 (socket says 172.21.15.26:53564) 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.231+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/2887174993 learned_addr learned my addr 172.21.15.26:0/2887174993 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b677fe640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680ccd30 0x7f5b68158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b67fff640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680b3840 0x7f5b6814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680ccd30 msgr2=0x7f5b68158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6cc4b640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680ccd30 0x7f5b68158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680b3840 msgr2=0x7f5b6814b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6cc4b640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680b3840 0x7f5b6814b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6cc4b640 1 -- 172.21.15.26:0/2887174993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b680c7c70 con 0x7f5b68155250 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b677fe640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680ccd30 0x7f5b68158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6cc4b640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68155250 0x7f5b680c8d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009f40 tx=0x7f5b60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b64ff9640 1 -- 172.21.15.26:0/2887174993 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6003f020 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b64ff9640 1 -- 172.21.15.26:0/2887174993 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60037040 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b680c7f50 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b64ff9640 1 -- 172.21.15.26:0/2887174993 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60036070 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.232+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6815a710 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.233+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b68068e40 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.234+0000 7f5b64ff9640 1 -- 172.21.15.26:0/2887174993 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b60042020 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.234+0000 7f5b64ff9640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5b5406c920 0x7f5b5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.234+0000 7f5b64ff9640 1 -- 172.21.15.26:0/2887174993 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f5b600ac3e0 con 0x7f5b68155250 2024-04-25T13:17:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.234+0000 7f5b67fff640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5b5406c920 0x7f5b5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.235+0000 7f5b67fff640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5b5406c920 0x7f5b5406ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5b58006fd0 tx=0x7f5b58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.238+0000 7f5b64ff9640 1 -- 172.21.15.26:0/2887174993 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b60049030 con 0x7f5b68155250 2024-04-25T13:17:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.422+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5b680b55e0 con 0x7f5b68155250 2024-04-25T13:17:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.423+0000 7f5b64ff9640 1 -- 172.21.15.26:0/2887174993 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f5b6007a460 con 0x7f5b68155250 2024-04-25T13:17:16.423 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-25T13:17:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5b5406c920 msgr2=0x7f5b5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5b5406c920 0x7f5b5406ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5b58006fd0 tx=0x7f5b58008040 comp rx=0 tx=0).stop 2024-04-25T13:17:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68155250 msgr2=0x7f5b680c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68155250 0x7f5b680c8d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009f40 tx=0x7f5b60004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 shutdown_connections 2024-04-25T13:17:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5b5406c920 0x7f5b5406ede0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68155250 0x7f5b680c8d00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680ccd30 0x7f5b68158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 --2- 172.21.15.26:0/2887174993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680b3840 0x7f5b6814b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.424+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 >> 172.21.15.26:0/2887174993 conn(0x7f5b680d0a00 msgr2=0x7f5b680c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.425+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 shutdown_connections 2024-04-25T13:17:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.425+0000 7f5b6e6ae640 1 -- 172.21.15.26:0/2887174993 wait complete. 2024-04-25T13:17:16.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:17:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.538+0000 7f80b632d640 1 Processor -- start 2024-04-25T13:17:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.538+0000 7f80b632d640 1 -- start start 2024-04-25T13:17:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.538+0000 7f80b632d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80b0155170 0x7f80b015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.538+0000 7f80b632d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b00ccf00 con 0x7f80b00cb9e0 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.538+0000 7f80b632d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b00cd1e0 con 0x7f80b0155550 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.538+0000 7f80b632d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f80b00cddf0 con 0x7f80b0155170 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80affff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80b0155170 0x7f80b015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80b48ca640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f80b00cb9e0 0x7f80b00c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34272/0 (socket says 172.21.15.26:34272) 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80affff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80b0155170 0x7f80b015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53566/0 (socket says 172.21.15.26:53566) 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80b48ca640 1 -- 172.21.15.26:0/2567346049 learned_addr learned my addr 172.21.15.26:0/2567346049 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80affff640 1 -- 172.21.15.26:0/2567346049 >> v1:172.21.15.169:6789/0 conn(0x7f80b0155550 legacy=0x7f80b00d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80affff640 1 -- 172.21.15.26:0/2567346049 >> v1:172.21.15.26:6789/0 conn(0x7f80b00cb9e0 legacy=0x7f80b00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80affff640 1 -- 172.21.15.26:0/2567346049 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b00cd4c0 con 0x7f80b0155170 2024-04-25T13:17:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.539+0000 7f80aeffd640 1 -- 172.21.15.26:0/2567346049 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052803100 0 0) 0x7f80b00ccf00 con 0x7f80b00cb9e0 2024-04-25T13:17:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80affff640 1 --2- 172.21.15.26:0/2567346049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b0155170 0x7f80b015eef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80b00cdf70 tx=0x7f80a402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338bc6b16d14fbfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80aeffd640 1 -- 172.21.15.26:0/2567346049 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4037070 con 0x7f80b0155170 2024-04-25T13:17:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80aeffd640 1 -- 172.21.15.26:0/2567346049 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4032440 con 0x7f80b0155170 2024-04-25T13:17:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80aeffd640 1 -- 172.21.15.26:0/2567346049 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4032810 con 0x7f80b0155170 2024-04-25T13:17:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80b632d640 1 -- 172.21.15.26:0/2567346049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b0155170 msgr2=0x7f80b015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80b632d640 1 --2- 172.21.15.26:0/2567346049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b0155170 0x7f80b015eef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80b00cdf70 tx=0x7f80a402a200 comp rx=0 tx=0).stop 2024-04-25T13:17:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80b632d640 1 -- 172.21.15.26:0/2567346049 shutdown_connections 2024-04-25T13:17:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80b632d640 1 --2- 172.21.15.26:0/2567346049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b0155170 0x7f80b015eef0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80b632d640 1 -- 172.21.15.26:0/2567346049 >> 172.21.15.26:0/2567346049 conn(0x7f80b0072570 msgr2=0x7f80b0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80b632d640 1 -- 172.21.15.26:0/2567346049 shutdown_connections 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.540+0000 7f80b632d640 1 -- 172.21.15.26:0/2567346049 wait complete. 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 Processor -- start 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 -- start start 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b00cb9e0 0x7f80b01f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b0155170 0x7f80b01f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80b0155550 0x7f80b00ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f80b00cda80 con 0x7f80b00cb9e0 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80b015f430 con 0x7f80b0155170 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.542+0000 7f80b632d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f80b00ccae0 con 0x7f80b0155550 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b00cb9e0 0x7f80b01f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b00cb9e0 0x7f80b01f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53578/0 (socket says 172.21.15.26:53578) 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 -- 172.21.15.26:0/1176899015 learned_addr learned my addr 172.21.15.26:0/1176899015 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80af7fe640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b0155170 0x7f80b01f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80b48ca640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80b0155550 0x7f80b00ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 -- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80b0155550 msgr2=0x7f80b00ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80b0155550 0x7f80b00ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 -- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b0155170 msgr2=0x7f80b01f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b0155170 0x7f80b01f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 -- 172.21.15.26:0/1176899015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b00ca610 con 0x7f80b00cb9e0 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80affff640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b00cb9e0 0x7f80b01f1930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f80a4000c00 tx=0x7f80a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80acff9640 1 -- 172.21.15.26:0/1176899015 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4037040 con 0x7f80b00cb9e0 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80acff9640 1 -- 172.21.15.26:0/1176899015 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4004230 con 0x7f80b00cb9e0 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b014ecf0 con 0x7f80b00cb9e0 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80acff9640 1 -- 172.21.15.26:0/1176899015 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a403c730 con 0x7f80b00cb9e0 2024-04-25T13:17:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.543+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b01f0e50 con 0x7f80b00cb9e0 2024-04-25T13:17:16.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.544+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b0068e40 con 0x7f80b00cb9e0 2024-04-25T13:17:16.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.545+0000 7f80acff9640 1 -- 172.21.15.26:0/1176899015 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80a403a070 con 0x7f80b00cb9e0 2024-04-25T13:17:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.545+0000 7f80acff9640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f809c06c920 0x7f809c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.545+0000 7f80acff9640 1 -- 172.21.15.26:0/1176899015 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f80a40ac860 con 0x7f80b00cb9e0 2024-04-25T13:17:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.545+0000 7f80af7fe640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f809c06c920 0x7f809c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.546+0000 7f80af7fe640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f809c06c920 0x7f809c06ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f80b01e7450 tx=0x7f80a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.550+0000 7f80acff9640 1 -- 172.21.15.26:0/1176899015 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f80a4041020 con 0x7f80b00cb9e0 2024-04-25T13:17:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.744+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f80b00cc2b0 con 0x7f80b00cb9e0 2024-04-25T13:17:16.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.745+0000 7f80acff9640 1 -- 172.21.15.26:0/1176899015 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f80a407a8e0 con 0x7f80b00cb9e0 2024-04-25T13:17:16.745 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-25T13:17:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f809c06c920 msgr2=0x7f809c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f809c06c920 0x7f809c06ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f80b01e7450 tx=0x7f80a0009040 comp rx=0 tx=0).stop 2024-04-25T13:17:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b00cb9e0 msgr2=0x7f80b01f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b00cb9e0 0x7f80b01f1930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f80a4000c00 tx=0x7f80a40046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 shutdown_connections 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f809c06c920 0x7f809c06ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80b0155550 0x7f80b00ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b0155170 0x7f80b01f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 --2- 172.21.15.26:0/1176899015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80b00cb9e0 0x7f80b01f1930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 >> 172.21.15.26:0/1176899015 conn(0x7f80b0072570 msgr2=0x7f80b01537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 shutdown_connections 2024-04-25T13:17:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:16.747+0000 7f80b632d640 1 -- 172.21.15.26:0/1176899015 wait complete. 2024-04-25T13:17:16.757 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2024-04-25T13:17:16.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:16.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:16.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[45196]: fuse finished with error 0 and tester_r 0 2024-04-25T13:17:16.782 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:17:22.884 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:17:22.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:22.884 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:17:22.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:22.904 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-25T13:17:22.962 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:17:22.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:22.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:23.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:23.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-04-25T13:17:23.128 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T13:17:23.138 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:17:23.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.247+0000 7f8da0ecf640 1 Processor -- start 2024-04-25T13:17:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.247+0000 7f8da0ecf640 1 -- start start 2024-04-25T13:17:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.248+0000 7f8da0ecf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8d9c152fd0 0x7f8d9c071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.248+0000 7f8da0ecf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c074410 0x7f8d9c15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.248+0000 7f8da0ecf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9c0c7bd0 con 0x7f8d9c0c6e00 2024-04-25T13:17:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.248+0000 7f8da0ecf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8d9c0c86a0 con 0x7f8d9c152fd0 2024-04-25T13:17:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.248+0000 7f8da0ecf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c0c8980 con 0x7f8d9c074410 2024-04-25T13:17:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d9a59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8d9c152fd0 0x7f8d9c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d99d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c074410 0x7f8d9c15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d9ad9d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f8d9c0c6e00 0x7f8d9c073730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:54414/0 (socket says 172.21.15.26:54414) 2024-04-25T13:17:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d9ad9d640 1 -- 172.21.15.26:0/2886131334 learned_addr learned my addr 172.21.15.26:0/2886131334 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d9959a640 1 -- 172.21.15.26:0/2886131334 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267657220 0 0) 0x7f8d9c0c7bd0 con 0x7f8d9c0c6e00 2024-04-25T13:17:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d9959a640 1 -- 172.21.15.26:0/2886131334 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d84003520 con 0x7f8d9c0c6e00 2024-04-25T13:17:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d99d9b640 1 -- 172.21.15.26:0/2886131334 >> v2:172.21.15.169:3300/0 conn(0x7f8d9c152fd0 msgr2=0x7f8d9c071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d99d9b640 1 --2- 172.21.15.26:0/2886131334 >> v2:172.21.15.169:3300/0 conn(0x7f8d9c152fd0 0x7f8d9c071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d99d9b640 1 -- 172.21.15.26:0/2886131334 >> v1:172.21.15.169:6789/0 conn(0x7f8d9c0c6e00 legacy=0x7f8d9c073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d99d9b640 1 -- 172.21.15.26:0/2886131334 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c15c3d0 con 0x7f8d9c074410 2024-04-25T13:17:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.249+0000 7f8d9a59c640 1 --2- 172.21.15.26:0/2886131334 >> v2:172.21.15.169:3300/0 conn(0x7f8d9c152fd0 0x7f8d9c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.250+0000 7f8d99d9b640 1 --2- 172.21.15.26:0/2886131334 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c074410 0x7f8d9c15ceb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d900097a0 tx=0x7f8d9002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f2f92337baf105 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.250+0000 7f8d9959a640 1 -- 172.21.15.26:0/2886131334 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90037070 con 0x7f8d9c074410 2024-04-25T13:17:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.250+0000 7f8d9959a640 1 -- 172.21.15.26:0/2886131334 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9002ae50 con 0x7f8d9c074410 2024-04-25T13:17:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.250+0000 7f8d9959a640 1 -- 172.21.15.26:0/2886131334 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90032640 con 0x7f8d9c074410 2024-04-25T13:17:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 -- 172.21.15.26:0/2886131334 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c074410 msgr2=0x7f8d9c15ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/2886131334 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c074410 0x7f8d9c15ceb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d900097a0 tx=0x7f8d9002a100 comp rx=0 tx=0).stop 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 -- 172.21.15.26:0/2886131334 shutdown_connections 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/2886131334 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c074410 0x7f8d9c15ceb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/2886131334 >> v2:172.21.15.169:3300/0 conn(0x7f8d9c152fd0 0x7f8d9c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 -- 172.21.15.26:0/2886131334 >> 172.21.15.26:0/2886131334 conn(0x7f8d9c0c8f00 msgr2=0x7f8d9c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 -- 172.21.15.26:0/2886131334 shutdown_connections 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.251+0000 7f8da0ecf640 1 -- 172.21.15.26:0/2886131334 wait complete. 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.252+0000 7f8da0ecf640 1 Processor -- start 2024-04-25T13:17:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.252+0000 7f8da0ecf640 1 -- start start 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8da0ecf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9c074410 0x7f8d9c1f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8da0ecf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c0c6e00 0x7f8d9c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8da0ecf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d9c152fd0 0x7f8d9c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8da0ecf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c0c8c60 con 0x7f8d9c074410 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8da0ecf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c15c990 con 0x7f8d9c152fd0 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8da0ecf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c1533b0 con 0x7f8d9c0c6e00 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9c074410 0x7f8d9c1f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9c074410 0x7f8d9c1f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53590/0 (socket says 172.21.15.26:53590) 2024-04-25T13:17:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 -- 172.21.15.26:0/3505488102 learned_addr learned my addr 172.21.15.26:0/3505488102 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9ad9d640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d9c152fd0 0x7f8d9c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d99d9b640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c0c6e00 0x7f8d9c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 -- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c0c6e00 msgr2=0x7f8d9c151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c0c6e00 0x7f8d9c151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 -- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d9c152fd0 msgr2=0x7f8d9c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d9c152fd0 0x7f8d9c155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 -- 172.21.15.26:0/3505488102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c148e00 con 0x7f8d9c074410 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d9a59c640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9c074410 0x7f8d9c1f1dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009ec0 tx=0x7f8d8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.253+0000 7f8d8affd640 1 -- 172.21.15.26:0/3505488102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c018020 con 0x7f8d9c074410 2024-04-25T13:17:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.254+0000 7f8d8affd640 1 -- 172.21.15.26:0/3505488102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8c014680 con 0x7f8d9c074410 2024-04-25T13:17:23.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.254+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c1506f0 con 0x7f8d9c074410 2024-04-25T13:17:23.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.254+0000 7f8d8affd640 1 -- 172.21.15.26:0/3505488102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c014a50 con 0x7f8d9c074410 2024-04-25T13:17:23.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.254+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c0cc530 con 0x7f8d9c074410 2024-04-25T13:17:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.255+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9c150c10 con 0x7f8d9c074410 2024-04-25T13:17:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.255+0000 7f8d8affd640 1 -- 172.21.15.26:0/3505488102 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d8c005d10 con 0x7f8d9c074410 2024-04-25T13:17:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.256+0000 7f8d8affd640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8d7c06c8f0 0x7f8d7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.256+0000 7f8d8affd640 1 -- 172.21.15.26:0/3505488102 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f8d8c08cc50 con 0x7f8d9c074410 2024-04-25T13:17:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.256+0000 7f8d99d9b640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8d7c06c8f0 0x7f8d7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.256+0000 7f8d99d9b640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8d7c06c8f0 0x7f8d7c06edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8d90034000 tx=0x7f8d9002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.260+0000 7f8d8affd640 1 -- 172.21.15.26:0/3505488102 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d9c150c10 con 0x7f8d9c074410 2024-04-25T13:17:23.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.442+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d9c148ba0 con 0x7f8d7c06c8f0 2024-04-25T13:17:23.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.451+0000 7f8d8affd640 1 -- 172.21.15.26:0/3505488102 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332628 (secure 0 0 0) 0x7f8d90030340 con 0x7f8d7c06c8f0 2024-04-25T13:17:23.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:23.456 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:17:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8d7c06c8f0 msgr2=0x7f8d7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8d7c06c8f0 0x7f8d7c06edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8d90034000 tx=0x7f8d9002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9c074410 msgr2=0x7f8d9c1f1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9c074410 0x7f8d9c1f1dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009ec0 tx=0x7f8d8c00c490 comp rx=0 tx=0).stop 2024-04-25T13:17:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 shutdown_connections 2024-04-25T13:17:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8d7c06c8f0 0x7f8d7c06edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d9c152fd0 0x7f8d9c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d9c0c6e00 0x7f8d9c151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 --2- 172.21.15.26:0/3505488102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d9c074410 0x7f8d9c1f1dc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 >> 172.21.15.26:0/3505488102 conn(0x7f8d9c0c8f00 msgr2=0x7f8d9c06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 shutdown_connections 2024-04-25T13:17:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.454+0000 7f8da0ecf640 1 -- 172.21.15.26:0/3505488102 wait complete. 2024-04-25T13:17:23.465 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-25T13:17:23.180199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":564,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002742"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388744+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:17:02.388744+0000","last_peered":"2024-04-25T13:17:02.388744+0000","last_clean":"2024-04-25T13:17:02.388744+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:17:02.388744+0000","last_undegraded":"2024-04-25T13:17:02.388744+0000","last_fullsized":"2024-04-25T13:17:02.388744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:27.622324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357827+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:50.357827+0000","last_peered":"2024-04-25T13:16:50.357827+0000","last_clean":"2024-04-25T13:16:50.357827+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:50.357827+0000","last_undegraded":"2024-04-25T13:16:50.357827+0000","last_fullsized":"2024-04-25T13:16:50.357827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355169+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:50.355169+0000","last_peered":"2024-04-25T13:16:50.355169+0000","last_clean":"2024-04-25T13:16:50.355169+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:50.355169+0000","last_undegraded":"2024-04-25T13:16:50.355169+0000","last_fullsized":"2024-04-25T13:16:50.355169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.360171+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:50.360171+0000","last_peered":"2024-04-25T13:16:50.360171+0000","last_clean":"2024-04-25T13:16:50.360171+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:50.360171+0000","last_undegraded":"2024-04-25T13:16:50.360171+0000","last_fullsized":"2024-04-25T13:16:50.360171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363517+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:50.363517+0000","last_peered":"2024-04-25T13:16:50.363517+0000","last_clean":"2024-04-25T13:16:50.363517+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:50.363517+0000","last_undegraded":"2024-04-25T13:16:50.363517+0000","last_fullsized":"2024-04-25T13:16:50.363517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:07.806920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362029+0000","last_change":"2024-04-25T13:16:50.362029+0000","last_active":"2024-04-25T13:16:50.362029+0000","last_peered":"2024-04-25T13:16:50.362029+0000","last_clean":"2024-04-25T13:16:50.362029+0000","last_became_active":"2024-04-25T13:16:50.361435+0000","last_became_peered":"2024-04-25T13:16:50.361435+0000","last_unstale":"2024-04-25T13:16:50.362029+0000","last_undegraded":"2024-04-25T13:16:50.362029+0000","last_fullsized":"2024-04-25T13:16:50.362029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:46.962760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391259+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:17:02.391259+0000","last_peered":"2024-04-25T13:17:02.391259+0000","last_clean":"2024-04-25T13:17:02.391259+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:17:02.391259+0000","last_undegraded":"2024-04-25T13:17:02.391259+0000","last_fullsized":"2024-04-25T13:17:02.391259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367333+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:50.367333+0000","last_peered":"2024-04-25T13:16:50.367333+0000","last_clean":"2024-04-25T13:16:50.367333+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:50.367333+0000","last_undegraded":"2024-04-25T13:16:50.367333+0000","last_fullsized":"2024-04-25T13:16:50.367333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355175+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:50.355175+0000","last_peered":"2024-04-25T13:16:50.355175+0000","last_clean":"2024-04-25T13:16:50.355175+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:50.355175+0000","last_undegraded":"2024-04-25T13:16:50.355175+0000","last_fullsized":"2024-04-25T13:16:50.355175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391164+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:17:02.391164+0000","last_peered":"2024-04-25T13:17:02.391164+0000","last_clean":"2024-04-25T13:17:02.391164+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:17:02.391164+0000","last_undegraded":"2024-04-25T13:17:02.391164+0000","last_fullsized":"2024-04-25T13:17:02.391164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368422+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:50.368422+0000","last_peered":"2024-04-25T13:16:50.368422+0000","last_clean":"2024-04-25T13:16:50.368422+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:50.368422+0000","last_undegraded":"2024-04-25T13:16:50.368422+0000","last_fullsized":"2024-04-25T13:16:50.368422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354866+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:50.354866+0000","last_peered":"2024-04-25T13:16:50.354866+0000","last_clean":"2024-04-25T13:16:50.354866+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:50.354866+0000","last_undegraded":"2024-04-25T13:16:50.354866+0000","last_fullsized":"2024-04-25T13:16:50.354866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356746+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:50.356746+0000","last_peered":"2024-04-25T13:16:50.356746+0000","last_clean":"2024-04-25T13:16:50.356746+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:50.356746+0000","last_undegraded":"2024-04-25T13:16:50.356746+0000","last_fullsized":"2024-04-25T13:16:50.356746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355245+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:50.355245+0000","last_peered":"2024-04-25T13:16:50.355245+0000","last_clean":"2024-04-25T13:16:50.355245+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:50.355245+0000","last_undegraded":"2024-04-25T13:16:50.355245+0000","last_fullsized":"2024-04-25T13:16:50.355245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355580+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:50.355580+0000","last_peered":"2024-04-25T13:16:50.355580+0000","last_clean":"2024-04-25T13:16:50.355580+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:50.355580+0000","last_undegraded":"2024-04-25T13:16:50.355580+0000","last_fullsized":"2024-04-25T13:16:50.355580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.359349+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:50.359349+0000","last_peered":"2024-04-25T13:16:50.359349+0000","last_clean":"2024-04-25T13:16:50.359349+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:50.359349+0000","last_undegraded":"2024-04-25T13:16:50.359349+0000","last_fullsized":"2024-04-25T13:16:50.359349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377123+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:56.377123+0000","last_peered":"2024-04-25T13:16:56.377123+0000","last_clean":"2024-04-25T13:16:56.377123+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:56.377123+0000","last_undegraded":"2024-04-25T13:16:56.377123+0000","last_fullsized":"2024-04-25T13:16:56.377123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.370263+0000","last_change":"2024-04-25T13:16:50.370263+0000","last_active":"2024-04-25T13:16:50.370263+0000","last_peered":"2024-04-25T13:16:50.370263+0000","last_clean":"2024-04-25T13:16:50.370263+0000","last_became_active":"2024-04-25T13:16:50.369812+0000","last_became_peered":"2024-04-25T13:16:50.369812+0000","last_unstale":"2024-04-25T13:16:50.370263+0000","last_undegraded":"2024-04-25T13:16:50.370263+0000","last_fullsized":"2024-04-25T13:16:50.370263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:03.168762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356486+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:50.356486+0000","last_peered":"2024-04-25T13:16:50.356486+0000","last_clean":"2024-04-25T13:16:50.356486+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:50.356486+0000","last_undegraded":"2024-04-25T13:16:50.356486+0000","last_fullsized":"2024-04-25T13:16:50.356486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.986821+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:17:02.986821+0000","last_peered":"2024-04-25T13:17:02.986821+0000","last_clean":"2024-04-25T13:17:02.986821+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:17:02.986821+0000","last_undegraded":"2024-04-25T13:17:02.986821+0000","last_fullsized":"2024-04-25T13:17:02.986821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363856+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:50.363856+0000","last_peered":"2024-04-25T13:16:50.363856+0000","last_clean":"2024-04-25T13:16:50.363856+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:50.363856+0000","last_undegraded":"2024-04-25T13:16:50.363856+0000","last_fullsized":"2024-04-25T13:16:50.363856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355128+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:50.355128+0000","last_peered":"2024-04-25T13:16:50.355128+0000","last_clean":"2024-04-25T13:16:50.355128+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:50.355128+0000","last_undegraded":"2024-04-25T13:16:50.355128+0000","last_fullsized":"2024-04-25T13:16:50.355128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354149+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:50.354149+0000","last_peered":"2024-04-25T13:16:50.354149+0000","last_clean":"2024-04-25T13:16:50.354149+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:50.354149+0000","last_undegraded":"2024-04-25T13:16:50.354149+0000","last_fullsized":"2024-04-25T13:16:50.354149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355790+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:50.355790+0000","last_peered":"2024-04-25T13:16:50.355790+0000","last_clean":"2024-04-25T13:16:50.355790+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:50.355790+0000","last_undegraded":"2024-04-25T13:16:50.355790+0000","last_fullsized":"2024-04-25T13:16:50.355790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362945+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:50.362945+0000","last_peered":"2024-04-25T13:16:50.362945+0000","last_clean":"2024-04-25T13:16:50.362945+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:50.362945+0000","last_undegraded":"2024-04-25T13:16:50.362945+0000","last_fullsized":"2024-04-25T13:16:50.362945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:07.387828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.390990+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:17:02.390990+0000","last_peered":"2024-04-25T13:17:02.390990+0000","last_clean":"2024-04-25T13:17:02.390990+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:17:02.390990+0000","last_undegraded":"2024-04-25T13:17:02.390990+0000","last_fullsized":"2024-04-25T13:17:02.390990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354770+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:50.354770+0000","last_peered":"2024-04-25T13:16:50.354770+0000","last_clean":"2024-04-25T13:16:50.354770+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:50.354770+0000","last_undegraded":"2024-04-25T13:16:50.354770+0000","last_fullsized":"2024-04-25T13:16:50.354770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357314+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:50.357314+0000","last_peered":"2024-04-25T13:16:50.357314+0000","last_clean":"2024-04-25T13:16:50.357314+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:50.357314+0000","last_undegraded":"2024-04-25T13:16:50.357314+0000","last_fullsized":"2024-04-25T13:16:50.357314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377315+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:56.377315+0000","last_peered":"2024-04-25T13:16:56.377315+0000","last_clean":"2024-04-25T13:16:56.377315+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:56.377315+0000","last_undegraded":"2024-04-25T13:16:56.377315+0000","last_fullsized":"2024-04-25T13:16:56.377315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355824+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:50.355824+0000","last_peered":"2024-04-25T13:16:50.355824+0000","last_clean":"2024-04-25T13:16:50.355824+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:50.355824+0000","last_undegraded":"2024-04-25T13:16:50.355824+0000","last_fullsized":"2024-04-25T13:16:50.355824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364127+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:50.364127+0000","last_peered":"2024-04-25T13:16:50.364127+0000","last_clean":"2024-04-25T13:16:50.364127+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:50.364127+0000","last_undegraded":"2024-04-25T13:16:50.364127+0000","last_fullsized":"2024-04-25T13:16:50.364127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377941+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:56.377941+0000","last_peered":"2024-04-25T13:16:56.377941+0000","last_clean":"2024-04-25T13:16:56.377941+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:56.377941+0000","last_undegraded":"2024-04-25T13:16:56.377941+0000","last_fullsized":"2024-04-25T13:16:56.377941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363869+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:50.363869+0000","last_peered":"2024-04-25T13:16:50.363869+0000","last_clean":"2024-04-25T13:16:50.363869+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:50.363869+0000","last_undegraded":"2024-04-25T13:16:50.363869+0000","last_fullsized":"2024-04-25T13:16:50.363869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:52.881166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368468+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:50.368468+0000","last_peered":"2024-04-25T13:16:50.368468+0000","last_clean":"2024-04-25T13:16:50.368468+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.368468+0000","last_undegraded":"2024-04-25T13:16:50.368468+0000","last_fullsized":"2024-04-25T13:16:50.368468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364301+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:50.364301+0000","last_peered":"2024-04-25T13:16:50.364301+0000","last_clean":"2024-04-25T13:16:50.364301+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:50.364301+0000","last_undegraded":"2024-04-25T13:16:50.364301+0000","last_fullsized":"2024-04-25T13:16:50.364301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364120+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:50.364120+0000","last_peered":"2024-04-25T13:16:50.364120+0000","last_clean":"2024-04-25T13:16:50.364120+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:50.364120+0000","last_undegraded":"2024-04-25T13:16:50.364120+0000","last_fullsized":"2024-04-25T13:16:50.364120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355530+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:50.355530+0000","last_peered":"2024-04-25T13:16:50.355530+0000","last_clean":"2024-04-25T13:16:50.355530+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:50.355530+0000","last_undegraded":"2024-04-25T13:16:50.355530+0000","last_fullsized":"2024-04-25T13:16:50.355530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388455+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:17:02.388455+0000","last_peered":"2024-04-25T13:17:02.388455+0000","last_clean":"2024-04-25T13:17:02.388455+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:17:02.388455+0000","last_undegraded":"2024-04-25T13:17:02.388455+0000","last_fullsized":"2024-04-25T13:17:02.388455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363511+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:50.363511+0000","last_peered":"2024-04-25T13:16:50.363511+0000","last_clean":"2024-04-25T13:16:50.363511+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:50.363511+0000","last_undegraded":"2024-04-25T13:16:50.363511+0000","last_fullsized":"2024-04-25T13:16:50.363511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364360+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:50.364360+0000","last_peered":"2024-04-25T13:16:50.364360+0000","last_clean":"2024-04-25T13:16:50.364360+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:50.364360+0000","last_undegraded":"2024-04-25T13:16:50.364360+0000","last_fullsized":"2024-04-25T13:16:50.364360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.386945+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:17:02.386945+0000","last_peered":"2024-04-25T13:17:02.386945+0000","last_clean":"2024-04-25T13:17:02.386945+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:17:02.386945+0000","last_undegraded":"2024-04-25T13:17:02.386945+0000","last_fullsized":"2024-04-25T13:17:02.386945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364118+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:50.364118+0000","last_peered":"2024-04-25T13:16:50.364118+0000","last_clean":"2024-04-25T13:16:50.364118+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:50.364118+0000","last_undegraded":"2024-04-25T13:16:50.364118+0000","last_fullsized":"2024-04-25T13:16:50.364118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364094+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:50.364094+0000","last_peered":"2024-04-25T13:16:50.364094+0000","last_clean":"2024-04-25T13:16:50.364094+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:50.364094+0000","last_undegraded":"2024-04-25T13:16:50.364094+0000","last_fullsized":"2024-04-25T13:16:50.364094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:14.197407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365277+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:50.365277+0000","last_peered":"2024-04-25T13:16:50.365277+0000","last_clean":"2024-04-25T13:16:50.365277+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:50.365277+0000","last_undegraded":"2024-04-25T13:16:50.365277+0000","last_fullsized":"2024-04-25T13:16:50.365277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362705+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:50.362705+0000","last_peered":"2024-04-25T13:16:50.362705+0000","last_clean":"2024-04-25T13:16:50.362705+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:50.362705+0000","last_undegraded":"2024-04-25T13:16:50.362705+0000","last_fullsized":"2024-04-25T13:16:50.362705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:00.494861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.373995+0000","last_change":"2024-04-25T13:16:50.373995+0000","last_active":"2024-04-25T13:16:50.373995+0000","last_peered":"2024-04-25T13:16:50.373995+0000","last_clean":"2024-04-25T13:16:50.373995+0000","last_became_active":"2024-04-25T13:16:50.373669+0000","last_became_peered":"2024-04-25T13:16:50.373669+0000","last_unstale":"2024-04-25T13:16:50.373995+0000","last_undegraded":"2024-04-25T13:16:50.373995+0000","last_fullsized":"2024-04-25T13:16:50.373995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:28.967657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376971+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:56.376971+0000","last_peered":"2024-04-25T13:16:56.376971+0000","last_clean":"2024-04-25T13:16:56.376971+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:56.376971+0000","last_undegraded":"2024-04-25T13:16:56.376971+0000","last_fullsized":"2024-04-25T13:16:56.376971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354328+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:50.354328+0000","last_peered":"2024-04-25T13:16:50.354328+0000","last_clean":"2024-04-25T13:16:50.354328+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:50.354328+0000","last_undegraded":"2024-04-25T13:16:50.354328+0000","last_fullsized":"2024-04-25T13:16:50.354328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357049+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:50.357049+0000","last_peered":"2024-04-25T13:16:50.357049+0000","last_clean":"2024-04-25T13:16:50.357049+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:50.357049+0000","last_undegraded":"2024-04-25T13:16:50.357049+0000","last_fullsized":"2024-04-25T13:16:50.357049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365712+0000","last_change":"2024-04-25T13:16:50.365712+0000","last_active":"2024-04-25T13:16:50.365712+0000","last_peered":"2024-04-25T13:16:50.365712+0000","last_clean":"2024-04-25T13:16:50.365712+0000","last_became_active":"2024-04-25T13:16:50.365465+0000","last_became_peered":"2024-04-25T13:16:50.365465+0000","last_unstale":"2024-04-25T13:16:50.365712+0000","last_undegraded":"2024-04-25T13:16:50.365712+0000","last_fullsized":"2024-04-25T13:16:50.365712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:02.718759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.778414+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:17:10.778414+0000","last_peered":"2024-04-25T13:17:10.778414+0000","last_clean":"2024-04-25T13:17:10.778414+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:17:10.778414+0000","last_undegraded":"2024-04-25T13:17:10.778414+0000","last_fullsized":"2024-04-25T13:17:10.778414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368982+0000","last_change":"2024-04-25T13:16:50.368982+0000","last_active":"2024-04-25T13:16:50.368982+0000","last_peered":"2024-04-25T13:16:50.368982+0000","last_clean":"2024-04-25T13:16:50.368982+0000","last_became_active":"2024-04-25T13:16:50.368538+0000","last_became_peered":"2024-04-25T13:16:50.368538+0000","last_unstale":"2024-04-25T13:16:50.368982+0000","last_undegraded":"2024-04-25T13:16:50.368982+0000","last_fullsized":"2024-04-25T13:16:50.368982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:47.805583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367386+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:50.367386+0000","last_peered":"2024-04-25T13:16:50.367386+0000","last_clean":"2024-04-25T13:16:50.367386+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:50.367386+0000","last_undegraded":"2024-04-25T13:16:50.367386+0000","last_fullsized":"2024-04-25T13:16:50.367386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377057+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:56.377057+0000","last_peered":"2024-04-25T13:16:56.377057+0000","last_clean":"2024-04-25T13:16:56.377057+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:56.377057+0000","last_undegraded":"2024-04-25T13:16:56.377057+0000","last_fullsized":"2024-04-25T13:16:56.377057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364093+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:50.364093+0000","last_peered":"2024-04-25T13:16:50.364093+0000","last_clean":"2024-04-25T13:16:50.364093+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:50.364093+0000","last_undegraded":"2024-04-25T13:16:50.364093+0000","last_fullsized":"2024-04-25T13:16:50.364093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:35.815826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355622+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:50.355622+0000","last_peered":"2024-04-25T13:16:50.355622+0000","last_clean":"2024-04-25T13:16:50.355622+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:50.355622+0000","last_undegraded":"2024-04-25T13:16:50.355622+0000","last_fullsized":"2024-04-25T13:16:50.355622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.385844+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:17:02.385844+0000","last_peered":"2024-04-25T13:17:02.385844+0000","last_clean":"2024-04-25T13:17:02.385844+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:17:02.385844+0000","last_undegraded":"2024-04-25T13:17:02.385844+0000","last_fullsized":"2024-04-25T13:17:02.385844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366656+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:50.366656+0000","last_peered":"2024-04-25T13:16:50.366656+0000","last_clean":"2024-04-25T13:16:50.366656+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:50.366656+0000","last_undegraded":"2024-04-25T13:16:50.366656+0000","last_fullsized":"2024-04-25T13:16:50.366656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354864+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:50.354864+0000","last_peered":"2024-04-25T13:16:50.354864+0000","last_clean":"2024-04-25T13:16:50.354864+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:50.354864+0000","last_undegraded":"2024-04-25T13:16:50.354864+0000","last_fullsized":"2024-04-25T13:16:50.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356040+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:50.356040+0000","last_peered":"2024-04-25T13:16:50.356040+0000","last_clean":"2024-04-25T13:16:50.356040+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:50.356040+0000","last_undegraded":"2024-04-25T13:16:50.356040+0000","last_fullsized":"2024-04-25T13:16:50.356040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354663+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:50.354663+0000","last_peered":"2024-04-25T13:16:50.354663+0000","last_clean":"2024-04-25T13:16:50.354663+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:50.354663+0000","last_undegraded":"2024-04-25T13:16:50.354663+0000","last_fullsized":"2024-04-25T13:16:50.354663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354424+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:50.354424+0000","last_peered":"2024-04-25T13:16:50.354424+0000","last_clean":"2024-04-25T13:16:50.354424+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:50.354424+0000","last_undegraded":"2024-04-25T13:16:50.354424+0000","last_fullsized":"2024-04-25T13:16:50.354424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377581+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:56.377581+0000","last_peered":"2024-04-25T13:16:56.377581+0000","last_clean":"2024-04-25T13:16:56.377581+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:56.377581+0000","last_undegraded":"2024-04-25T13:16:56.377581+0000","last_fullsized":"2024-04-25T13:16:56.377581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362572+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:50.362572+0000","last_peered":"2024-04-25T13:16:50.362572+0000","last_clean":"2024-04-25T13:16:50.362572+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:50.362572+0000","last_undegraded":"2024-04-25T13:16:50.362572+0000","last_fullsized":"2024-04-25T13:16:50.362572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:15.310573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356614+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:50.356614+0000","last_peered":"2024-04-25T13:16:50.356614+0000","last_clean":"2024-04-25T13:16:50.356614+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:50.356614+0000","last_undegraded":"2024-04-25T13:16:50.356614+0000","last_fullsized":"2024-04-25T13:16:50.356614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.783746+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:17:10.783746+0000","last_peered":"2024-04-25T13:17:10.783746+0000","last_clean":"2024-04-25T13:17:10.783746+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:17:10.783746+0000","last_undegraded":"2024-04-25T13:17:10.783746+0000","last_fullsized":"2024-04-25T13:17:10.783746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357157+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:50.357157+0000","last_peered":"2024-04-25T13:16:50.357157+0000","last_clean":"2024-04-25T13:16:50.357157+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:50.357157+0000","last_undegraded":"2024-04-25T13:16:50.357157+0000","last_fullsized":"2024-04-25T13:16:50.357157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355199+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:50.355199+0000","last_peered":"2024-04-25T13:16:50.355199+0000","last_clean":"2024-04-25T13:16:50.355199+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:50.355199+0000","last_undegraded":"2024-04-25T13:16:50.355199+0000","last_fullsized":"2024-04-25T13:16:50.355199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376519+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:56.376519+0000","last_peered":"2024-04-25T13:16:56.376519+0000","last_clean":"2024-04-25T13:16:56.376519+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:56.376519+0000","last_undegraded":"2024-04-25T13:16:56.376519+0000","last_fullsized":"2024-04-25T13:16:56.376519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.358023+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:50.358023+0000","last_peered":"2024-04-25T13:16:50.358023+0000","last_clean":"2024-04-25T13:16:50.358023+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:50.358023+0000","last_undegraded":"2024-04-25T13:16:50.358023+0000","last_fullsized":"2024-04-25T13:16:50.358023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362160+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:50.362160+0000","last_peered":"2024-04-25T13:16:50.362160+0000","last_clean":"2024-04-25T13:16:50.362160+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:50.362160+0000","last_undegraded":"2024-04-25T13:16:50.362160+0000","last_fullsized":"2024-04-25T13:16:50.362160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:24.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.386036+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:17:02.386036+0000","last_peered":"2024-04-25T13:17:02.386036+0000","last_clean":"2024-04-25T13:17:02.386036+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:17:02.386036+0000","last_undegraded":"2024-04-25T13:17:02.386036+0000","last_fullsized":"2024-04-25T13:17:02.386036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:49.859293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368372+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:50.368372+0000","last_peered":"2024-04-25T13:16:50.368372+0000","last_clean":"2024-04-25T13:16:50.368372+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:50.368372+0000","last_undegraded":"2024-04-25T13:16:50.368372+0000","last_fullsized":"2024-04-25T13:16:50.368372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355360+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:50.355360+0000","last_peered":"2024-04-25T13:16:50.355360+0000","last_clean":"2024-04-25T13:16:50.355360+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:50.355360+0000","last_undegraded":"2024-04-25T13:16:50.355360+0000","last_fullsized":"2024-04-25T13:16:50.355360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.988017+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:17:10.988017+0000","last_peered":"2024-04-25T13:17:10.988017+0000","last_clean":"2024-04-25T13:17:10.988017+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:17:10.988017+0000","last_undegraded":"2024-04-25T13:17:10.988017+0000","last_fullsized":"2024-04-25T13:17:10.988017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364968+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:50.364968+0000","last_peered":"2024-04-25T13:16:50.364968+0000","last_clean":"2024-04-25T13:16:50.364968+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:50.364968+0000","last_undegraded":"2024-04-25T13:16:50.364968+0000","last_fullsized":"2024-04-25T13:16:50.364968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355772+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:50.355772+0000","last_peered":"2024-04-25T13:16:50.355772+0000","last_clean":"2024-04-25T13:16:50.355772+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:50.355772+0000","last_undegraded":"2024-04-25T13:16:50.355772+0000","last_fullsized":"2024-04-25T13:16:50.355772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364593+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:50.364593+0000","last_peered":"2024-04-25T13:16:50.364593+0000","last_clean":"2024-04-25T13:16:50.364593+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:50.364593+0000","last_undegraded":"2024-04-25T13:16:50.364593+0000","last_fullsized":"2024-04-25T13:16:50.364593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355323+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:50.355323+0000","last_peered":"2024-04-25T13:16:50.355323+0000","last_clean":"2024-04-25T13:16:50.355323+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:50.355323+0000","last_undegraded":"2024-04-25T13:16:50.355323+0000","last_fullsized":"2024-04-25T13:16:50.355323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363727+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:50.363727+0000","last_peered":"2024-04-25T13:16:50.363727+0000","last_clean":"2024-04-25T13:16:50.363727+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:50.363727+0000","last_undegraded":"2024-04-25T13:16:50.363727+0000","last_fullsized":"2024-04-25T13:16:50.363727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:59.519018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391208+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:17:02.391208+0000","last_peered":"2024-04-25T13:17:02.391208+0000","last_clean":"2024-04-25T13:17:02.391208+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:17:02.391208+0000","last_undegraded":"2024-04-25T13:17:02.391208+0000","last_fullsized":"2024-04-25T13:17:02.391208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356204+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:50.356204+0000","last_peered":"2024-04-25T13:16:50.356204+0000","last_clean":"2024-04-25T13:16:50.356204+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:50.356204+0000","last_undegraded":"2024-04-25T13:16:50.356204+0000","last_fullsized":"2024-04-25T13:16:50.356204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367495+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:50.367495+0000","last_peered":"2024-04-25T13:16:50.367495+0000","last_clean":"2024-04-25T13:16:50.367495+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:50.367495+0000","last_undegraded":"2024-04-25T13:16:50.367495+0000","last_fullsized":"2024-04-25T13:16:50.367495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781217+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:17:10.781217+0000","last_peered":"2024-04-25T13:17:10.781217+0000","last_clean":"2024-04-25T13:17:10.781217+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:17:10.781217+0000","last_undegraded":"2024-04-25T13:17:10.781217+0000","last_fullsized":"2024-04-25T13:17:10.781217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355305+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:50.355305+0000","last_peered":"2024-04-25T13:16:50.355305+0000","last_clean":"2024-04-25T13:16:50.355305+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:50.355305+0000","last_undegraded":"2024-04-25T13:16:50.355305+0000","last_fullsized":"2024-04-25T13:16:50.355305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362452+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:50.362452+0000","last_peered":"2024-04-25T13:16:50.362452+0000","last_clean":"2024-04-25T13:16:50.362452+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:50.362452+0000","last_undegraded":"2024-04-25T13:16:50.362452+0000","last_fullsized":"2024-04-25T13:16:50.362452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.475502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363321+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:50.363321+0000","last_peered":"2024-04-25T13:16:50.363321+0000","last_clean":"2024-04-25T13:16:50.363321+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:50.363321+0000","last_undegraded":"2024-04-25T13:16:50.363321+0000","last_fullsized":"2024-04-25T13:16:50.363321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376012+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:56.376012+0000","last_peered":"2024-04-25T13:16:56.376012+0000","last_clean":"2024-04-25T13:16:56.376012+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:56.376012+0000","last_undegraded":"2024-04-25T13:16:56.376012+0000","last_fullsized":"2024-04-25T13:16:56.376012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357030+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:50.357030+0000","last_peered":"2024-04-25T13:16:50.357030+0000","last_clean":"2024-04-25T13:16:50.357030+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:50.357030+0000","last_undegraded":"2024-04-25T13:16:50.357030+0000","last_fullsized":"2024-04-25T13:16:50.357030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372604+0000","last_change":"2024-04-25T13:16:50.370489+0000","last_active":"2024-04-25T13:16:50.372604+0000","last_peered":"2024-04-25T13:16:50.372604+0000","last_clean":"2024-04-25T13:16:50.372604+0000","last_became_active":"2024-04-25T13:16:50.370143+0000","last_became_peered":"2024-04-25T13:16:50.370143+0000","last_unstale":"2024-04-25T13:16:50.372604+0000","last_undegraded":"2024-04-25T13:16:50.372604+0000","last_fullsized":"2024-04-25T13:16:50.372604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:06.845107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365416+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:50.365416+0000","last_peered":"2024-04-25T13:16:50.365416+0000","last_clean":"2024-04-25T13:16:50.365416+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:50.365416+0000","last_undegraded":"2024-04-25T13:16:50.365416+0000","last_fullsized":"2024-04-25T13:16:50.365416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376785+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:56.376785+0000","last_peered":"2024-04-25T13:16:56.376785+0000","last_clean":"2024-04-25T13:16:56.376785+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:56.376785+0000","last_undegraded":"2024-04-25T13:16:56.376785+0000","last_fullsized":"2024-04-25T13:16:56.376785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364240+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:50.364240+0000","last_peered":"2024-04-25T13:16:50.364240+0000","last_clean":"2024-04-25T13:16:50.364240+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:50.364240+0000","last_undegraded":"2024-04-25T13:16:50.364240+0000","last_fullsized":"2024-04-25T13:16:50.364240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366699+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:50.366699+0000","last_peered":"2024-04-25T13:16:50.366699+0000","last_clean":"2024-04-25T13:16:50.366699+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:50.366699+0000","last_undegraded":"2024-04-25T13:16:50.366699+0000","last_fullsized":"2024-04-25T13:16:50.366699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781407+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:17:10.781407+0000","last_peered":"2024-04-25T13:17:10.781407+0000","last_clean":"2024-04-25T13:17:10.781407+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:17:10.781407+0000","last_undegraded":"2024-04-25T13:17:10.781407+0000","last_fullsized":"2024-04-25T13:17:10.781407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356066+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:50.356066+0000","last_peered":"2024-04-25T13:16:50.356066+0000","last_clean":"2024-04-25T13:16:50.356066+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:50.356066+0000","last_undegraded":"2024-04-25T13:16:50.356066+0000","last_fullsized":"2024-04-25T13:16:50.356066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357602+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:50.357602+0000","last_peered":"2024-04-25T13:16:50.357602+0000","last_clean":"2024-04-25T13:16:50.357602+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:50.357602+0000","last_undegraded":"2024-04-25T13:16:50.357602+0000","last_fullsized":"2024-04-25T13:16:50.357602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356114+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:50.356114+0000","last_peered":"2024-04-25T13:16:50.356114+0000","last_clean":"2024-04-25T13:16:50.356114+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:50.356114+0000","last_undegraded":"2024-04-25T13:16:50.356114+0000","last_fullsized":"2024-04-25T13:16:50.356114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366795+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:50.366795+0000","last_peered":"2024-04-25T13:16:50.366795+0000","last_clean":"2024-04-25T13:16:50.366795+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:50.366795+0000","last_undegraded":"2024-04-25T13:16:50.366795+0000","last_fullsized":"2024-04-25T13:16:50.366795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366978+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:50.366978+0000","last_peered":"2024-04-25T13:16:50.366978+0000","last_clean":"2024-04-25T13:16:50.366978+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:50.366978+0000","last_undegraded":"2024-04-25T13:16:50.366978+0000","last_fullsized":"2024-04-25T13:16:50.366978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364140+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:50.364140+0000","last_peered":"2024-04-25T13:16:50.364140+0000","last_clean":"2024-04-25T13:16:50.364140+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:50.364140+0000","last_undegraded":"2024-04-25T13:16:50.364140+0000","last_fullsized":"2024-04-25T13:16:50.364140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:23.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372415+0000","last_change":"2024-04-25T13:16:50.369947+0000","last_active":"2024-04-25T13:16:50.372415+0000","last_peered":"2024-04-25T13:16:50.372415+0000","last_clean":"2024-04-25T13:16:50.372415+0000","last_became_active":"2024-04-25T13:16:50.369437+0000","last_became_peered":"2024-04-25T13:16:50.369437+0000","last_unstale":"2024-04-25T13:16:50.372415+0000","last_undegraded":"2024-04-25T13:16:50.372415+0000","last_fullsized":"2024-04-25T13:16:50.372415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:26.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363154+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:50.363154+0000","last_peered":"2024-04-25T13:16:50.363154+0000","last_clean":"2024-04-25T13:16:50.363154+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:50.363154+0000","last_undegraded":"2024-04-25T13:16:50.363154+0000","last_fullsized":"2024-04-25T13:16:50.363154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357306+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:50.357306+0000","last_peered":"2024-04-25T13:16:50.357306+0000","last_clean":"2024-04-25T13:16:50.357306+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:50.357306+0000","last_undegraded":"2024-04-25T13:16:50.357306+0000","last_fullsized":"2024-04-25T13:16:50.357306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357159+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:50.357159+0000","last_peered":"2024-04-25T13:16:50.357159+0000","last_clean":"2024-04-25T13:16:50.357159+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:50.357159+0000","last_undegraded":"2024-04-25T13:16:50.357159+0000","last_fullsized":"2024-04-25T13:16:50.357159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366748+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:50.366748+0000","last_peered":"2024-04-25T13:16:50.366748+0000","last_clean":"2024-04-25T13:16:50.366748+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:50.366748+0000","last_undegraded":"2024-04-25T13:16:50.366748+0000","last_fullsized":"2024-04-25T13:16:50.366748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355469+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:50.355469+0000","last_peered":"2024-04-25T13:16:50.355469+0000","last_clean":"2024-04-25T13:16:50.355469+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:50.355469+0000","last_undegraded":"2024-04-25T13:16:50.355469+0000","last_fullsized":"2024-04-25T13:16:50.355469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366885+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:50.366885+0000","last_peered":"2024-04-25T13:16:50.366885+0000","last_clean":"2024-04-25T13:16:50.366885+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:50.366885+0000","last_undegraded":"2024-04-25T13:16:50.366885+0000","last_fullsized":"2024-04-25T13:16:50.366885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363969+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:50.363969+0000","last_peered":"2024-04-25T13:16:50.363969+0000","last_clean":"2024-04-25T13:16:50.363969+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:50.363969+0000","last_undegraded":"2024-04-25T13:16:50.363969+0000","last_fullsized":"2024-04-25T13:16:50.363969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:52.980650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357173+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:50.357173+0000","last_peered":"2024-04-25T13:16:50.357173+0000","last_clean":"2024-04-25T13:16:50.357173+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:50.357173+0000","last_undegraded":"2024-04-25T13:16:50.357173+0000","last_fullsized":"2024-04-25T13:16:50.357173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355881+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:50.355881+0000","last_peered":"2024-04-25T13:16:50.355881+0000","last_clean":"2024-04-25T13:16:50.355881+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:50.355881+0000","last_undegraded":"2024-04-25T13:16:50.355881+0000","last_fullsized":"2024-04-25T13:16:50.355881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366734+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:50.366734+0000","last_peered":"2024-04-25T13:16:50.366734+0000","last_clean":"2024-04-25T13:16:50.366734+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:50.366734+0000","last_undegraded":"2024-04-25T13:16:50.366734+0000","last_fullsized":"2024-04-25T13:16:50.366734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367697+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:50.367697+0000","last_peered":"2024-04-25T13:16:50.367697+0000","last_clean":"2024-04-25T13:16:50.367697+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:50.367697+0000","last_undegraded":"2024-04-25T13:16:50.367697+0000","last_fullsized":"2024-04-25T13:16:50.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366727+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:50.366727+0000","last_peered":"2024-04-25T13:16:50.366727+0000","last_clean":"2024-04-25T13:16:50.366727+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:50.366727+0000","last_undegraded":"2024-04-25T13:16:50.366727+0000","last_fullsized":"2024-04-25T13:16:50.366727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363431+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:50.363431+0000","last_peered":"2024-04-25T13:16:50.363431+0000","last_clean":"2024-04-25T13:16:50.363431+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:50.363431+0000","last_undegraded":"2024-04-25T13:16:50.363431+0000","last_fullsized":"2024-04-25T13:16:50.363431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362040+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:50.362040+0000","last_peered":"2024-04-25T13:16:50.362040+0000","last_clean":"2024-04-25T13:16:50.362040+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:50.362040+0000","last_undegraded":"2024-04-25T13:16:50.362040+0000","last_fullsized":"2024-04-25T13:16:50.362040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:44.821443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356705+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:50.356705+0000","last_peered":"2024-04-25T13:16:50.356705+0000","last_clean":"2024-04-25T13:16:50.356705+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:50.356705+0000","last_undegraded":"2024-04-25T13:16:50.356705+0000","last_fullsized":"2024-04-25T13:16:50.356705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355690+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:50.355690+0000","last_peered":"2024-04-25T13:16:50.355690+0000","last_clean":"2024-04-25T13:16:50.355690+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:50.355690+0000","last_undegraded":"2024-04-25T13:16:50.355690+0000","last_fullsized":"2024-04-25T13:16:50.355690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357158+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:50.357158+0000","last_peered":"2024-04-25T13:16:50.357158+0000","last_clean":"2024-04-25T13:16:50.357158+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.357158+0000","last_undegraded":"2024-04-25T13:16:50.357158+0000","last_fullsized":"2024-04-25T13:16:50.357158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357282+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:50.357282+0000","last_peered":"2024-04-25T13:16:50.357282+0000","last_clean":"2024-04-25T13:16:50.357282+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:50.357282+0000","last_undegraded":"2024-04-25T13:16:50.357282+0000","last_fullsized":"2024-04-25T13:16:50.357282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365616+0000","last_change":"2024-04-25T13:16:50.365616+0000","last_active":"2024-04-25T13:16:50.365616+0000","last_peered":"2024-04-25T13:16:50.365616+0000","last_clean":"2024-04-25T13:16:50.365616+0000","last_became_active":"2024-04-25T13:16:50.365415+0000","last_became_peered":"2024-04-25T13:16:50.365415+0000","last_unstale":"2024-04-25T13:16:50.365616+0000","last_undegraded":"2024-04-25T13:16:50.365616+0000","last_fullsized":"2024-04-25T13:16:50.365616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:37.667075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356014+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:50.356014+0000","last_peered":"2024-04-25T13:16:50.356014+0000","last_clean":"2024-04-25T13:16:50.356014+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:50.356014+0000","last_undegraded":"2024-04-25T13:16:50.356014+0000","last_fullsized":"2024-04-25T13:16:50.356014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372305+0000","last_change":"2024-04-25T13:16:50.370418+0000","last_active":"2024-04-25T13:16:50.372305+0000","last_peered":"2024-04-25T13:16:50.372305+0000","last_clean":"2024-04-25T13:16:50.372305+0000","last_became_active":"2024-04-25T13:16:50.370066+0000","last_became_peered":"2024-04-25T13:16:50.370066+0000","last_unstale":"2024-04-25T13:16:50.372305+0000","last_undegraded":"2024-04-25T13:16:50.372305+0000","last_fullsized":"2024-04-25T13:16:50.372305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:17.756850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366860+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:50.366860+0000","last_peered":"2024-04-25T13:16:50.366860+0000","last_clean":"2024-04-25T13:16:50.366860+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:50.366860+0000","last_undegraded":"2024-04-25T13:16:50.366860+0000","last_fullsized":"2024-04-25T13:16:50.366860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355061+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:50.355061+0000","last_peered":"2024-04-25T13:16:50.355061+0000","last_clean":"2024-04-25T13:16:50.355061+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:50.355061+0000","last_undegraded":"2024-04-25T13:16:50.355061+0000","last_fullsized":"2024-04-25T13:16:50.355061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367300+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:50.367300+0000","last_peered":"2024-04-25T13:16:50.367300+0000","last_clean":"2024-04-25T13:16:50.367300+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:50.367300+0000","last_undegraded":"2024-04-25T13:16:50.367300+0000","last_fullsized":"2024-04-25T13:16:50.367300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363217+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:50.363217+0000","last_peered":"2024-04-25T13:16:50.363217+0000","last_clean":"2024-04-25T13:16:50.363217+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:50.363217+0000","last_undegraded":"2024-04-25T13:16:50.363217+0000","last_fullsized":"2024-04-25T13:16:50.363217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:51.820664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362907+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:50.362907+0000","last_peered":"2024-04-25T13:16:50.362907+0000","last_clean":"2024-04-25T13:16:50.362907+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:50.362907+0000","last_undegraded":"2024-04-25T13:16:50.362907+0000","last_fullsized":"2024-04-25T13:16:50.362907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355523+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:50.355523+0000","last_peered":"2024-04-25T13:16:50.355523+0000","last_clean":"2024-04-25T13:16:50.355523+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:50.355523+0000","last_undegraded":"2024-04-25T13:16:50.355523+0000","last_fullsized":"2024-04-25T13:16:50.355523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":120093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:23.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:23.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.605+0000 7f41505d8640 1 Processor -- start 2024-04-25T13:17:23.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.605+0000 7f41505d8640 1 -- start start 2024-04-25T13:17:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f41505d8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f414806bb90 0x7f414815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f41505d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41480c99f0 0x7f41480c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f41505d8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f414815bef0 con 0x7f414806bf70 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f41505d8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f414815f510 con 0x7f414806bb90 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f41505d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f414815b650 con 0x7f41480c99f0 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f414e374640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f414806bb90 0x7f414815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f414e374640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f414806bb90 0x7f414815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53598/0 (socket says 172.21.15.26:53598) 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f414e374640 1 -- 172.21.15.26:0/1792975407 learned_addr learned my addr 172.21.15.26:0/1792975407 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.606+0000 7f414eb75640 1 --2- 172.21.15.26:0/1792975407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41480c99f0 0x7f41480c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.607+0000 7f414e374640 1 -- 172.21.15.26:0/1792975407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41480c99f0 msgr2=0x7f41480c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.607+0000 7f414e374640 1 --2- 172.21.15.26:0/1792975407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41480c99f0 0x7f41480c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.607+0000 7f414e374640 1 -- 172.21.15.26:0/1792975407 >> v1:172.21.15.169:6789/0 conn(0x7f414806bf70 legacy=0x7f414815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.607+0000 7f414e374640 1 -- 172.21.15.26:0/1792975407 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414815b930 con 0x7f414806bb90 2024-04-25T13:17:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.607+0000 7f414eb75640 1 --2- 172.21.15.26:0/1792975407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41480c99f0 0x7f41480c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.607+0000 7f414e374640 1 --2- 172.21.15.26:0/1792975407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414806bb90 0x7f414815af70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4140009e50 tx=0x7f414002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29af734654b4d24a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.607+0000 7f414d372640 1 -- 172.21.15.26:0/1792975407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140036070 con 0x7f414806bb90 2024-04-25T13:17:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f414d372640 1 -- 172.21.15.26:0/1792975407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4140031600 con 0x7f414806bb90 2024-04-25T13:17:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f414d372640 1 -- 172.21.15.26:0/1792975407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400319d0 con 0x7f414806bb90 2024-04-25T13:17:23.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 -- 172.21.15.26:0/1792975407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414806bb90 msgr2=0x7f414815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 --2- 172.21.15.26:0/1792975407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414806bb90 0x7f414815af70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4140009e50 tx=0x7f414002a7a0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 -- 172.21.15.26:0/1792975407 shutdown_connections 2024-04-25T13:17:23.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 --2- 172.21.15.26:0/1792975407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41480c99f0 0x7f41480c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 --2- 172.21.15.26:0/1792975407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414806bb90 0x7f414815af70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 -- 172.21.15.26:0/1792975407 >> 172.21.15.26:0/1792975407 conn(0x7f4148074d50 msgr2=0x7f4148075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 -- 172.21.15.26:0/1792975407 shutdown_connections 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.608+0000 7f41505d8640 1 -- 172.21.15.26:0/1792975407 wait complete. 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.609+0000 7f41505d8640 1 Processor -- start 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.609+0000 7f41505d8640 1 -- start start 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f41505d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f414806bb90 0x7f4148159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f41505d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f414806bf70 0x7f41481558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f41505d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41480c99f0 0x7f41481453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f41505d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f414815e8e0 con 0x7f41480c99f0 2024-04-25T13:17:23.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f41505d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f414815e600 con 0x7f414806bf70 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f41505d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4148074560 con 0x7f414806bb90 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41480c99f0 0x7f41481453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41480c99f0 0x7f41481453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53610/0 (socket says 172.21.15.26:53610) 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 -- 172.21.15.26:0/1107095088 learned_addr learned my addr 172.21.15.26:0/1107095088 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414e374640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f414806bb90 0x7f4148159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414db73640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f414806bf70 0x7f41481558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 -- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f414806bb90 msgr2=0x7f4148159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f414806bb90 0x7f4148159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 -- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f414806bf70 msgr2=0x7f41481558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f414806bf70 0x7f41481558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.610+0000 7f414eb75640 1 -- 172.21.15.26:0/1107095088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414815ae90 con 0x7f41480c99f0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.611+0000 7f414eb75640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41480c99f0 0x7f41481453b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f413800d5c0 tx=0x7f413800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.611+0000 7f4146ffd640 1 -- 172.21.15.26:0/1107095088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138004030 con 0x7f41480c99f0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.611+0000 7f4146ffd640 1 -- 172.21.15.26:0/1107095088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41380041d0 con 0x7f41480c99f0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.611+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414814a260 con 0x7f41480c99f0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.611+0000 7f4146ffd640 1 -- 172.21.15.26:0/1107095088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138003610 con 0x7f41480c99f0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.611+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414814a820 con 0x7f41480c99f0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.612+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41480696c0 con 0x7f41480c99f0 2024-04-25T13:17:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.612+0000 7f4146ffd640 1 -- 172.21.15.26:0/1107095088 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41380037b0 con 0x7f41480c99f0 2024-04-25T13:17:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.613+0000 7f4146ffd640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f413406c920 0x7f413406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.613+0000 7f4146ffd640 1 -- 172.21.15.26:0/1107095088 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f413808c150 con 0x7f41480c99f0 2024-04-25T13:17:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.613+0000 7f414e374640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f413406c920 0x7f413406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.614+0000 7f414e374640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f413406c920 0x7f413406ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4140033000 tx=0x7f4140009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.617+0000 7f4146ffd640 1 -- 172.21.15.26:0/1107095088 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f41480696c0 con 0x7f41480c99f0 2024-04-25T13:17:23.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.798+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f414815b170 con 0x7f413406c920 2024-04-25T13:17:23.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.806+0000 7f4146ffd640 1 -- 172.21.15.26:0/1107095088 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332628 (secure 0 0 0) 0x7f414815b170 con 0x7f413406c920 2024-04-25T13:17:23.810 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:23.811 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:17:23.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f413406c920 msgr2=0x7f413406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f413406c920 0x7f413406ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4140033000 tx=0x7f4140009000 comp rx=0 tx=0).stop 2024-04-25T13:17:23.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41480c99f0 msgr2=0x7f41481453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41480c99f0 0x7f41481453b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f413800d5c0 tx=0x7f413800da80 comp rx=0 tx=0).stop 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 shutdown_connections 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f413406c920 0x7f413406ede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41480c99f0 0x7f41481453b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f414806bf70 0x7f41481558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 --2- 172.21.15.26:0/1107095088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f414806bb90 0x7f4148159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 >> 172.21.15.26:0/1107095088 conn(0x7f4148074d50 msgr2=0x7f4148154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 shutdown_connections 2024-04-25T13:17:23.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.810+0000 7f41505d8640 1 -- 172.21.15.26:0/1107095088 wait complete. 2024-04-25T13:17:23.820 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-25T13:17:23.180199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":564,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002742"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388744+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:17:02.388744+0000","last_peered":"2024-04-25T13:17:02.388744+0000","last_clean":"2024-04-25T13:17:02.388744+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:17:02.388744+0000","last_undegraded":"2024-04-25T13:17:02.388744+0000","last_fullsized":"2024-04-25T13:17:02.388744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:27.622324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357827+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:50.357827+0000","last_peered":"2024-04-25T13:16:50.357827+0000","last_clean":"2024-04-25T13:16:50.357827+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:50.357827+0000","last_undegraded":"2024-04-25T13:16:50.357827+0000","last_fullsized":"2024-04-25T13:16:50.357827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355169+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:50.355169+0000","last_peered":"2024-04-25T13:16:50.355169+0000","last_clean":"2024-04-25T13:16:50.355169+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:50.355169+0000","last_undegraded":"2024-04-25T13:16:50.355169+0000","last_fullsized":"2024-04-25T13:16:50.355169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.360171+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:50.360171+0000","last_peered":"2024-04-25T13:16:50.360171+0000","last_clean":"2024-04-25T13:16:50.360171+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:50.360171+0000","last_undegraded":"2024-04-25T13:16:50.360171+0000","last_fullsized":"2024-04-25T13:16:50.360171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363517+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:50.363517+0000","last_peered":"2024-04-25T13:16:50.363517+0000","last_clean":"2024-04-25T13:16:50.363517+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:50.363517+0000","last_undegraded":"2024-04-25T13:16:50.363517+0000","last_fullsized":"2024-04-25T13:16:50.363517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:07.806920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362029+0000","last_change":"2024-04-25T13:16:50.362029+0000","last_active":"2024-04-25T13:16:50.362029+0000","last_peered":"2024-04-25T13:16:50.362029+0000","last_clean":"2024-04-25T13:16:50.362029+0000","last_became_active":"2024-04-25T13:16:50.361435+0000","last_became_peered":"2024-04-25T13:16:50.361435+0000","last_unstale":"2024-04-25T13:16:50.362029+0000","last_undegraded":"2024-04-25T13:16:50.362029+0000","last_fullsized":"2024-04-25T13:16:50.362029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:46.962760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391259+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:17:02.391259+0000","last_peered":"2024-04-25T13:17:02.391259+0000","last_clean":"2024-04-25T13:17:02.391259+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:17:02.391259+0000","last_undegraded":"2024-04-25T13:17:02.391259+0000","last_fullsized":"2024-04-25T13:17:02.391259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367333+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:50.367333+0000","last_peered":"2024-04-25T13:16:50.367333+0000","last_clean":"2024-04-25T13:16:50.367333+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:50.367333+0000","last_undegraded":"2024-04-25T13:16:50.367333+0000","last_fullsized":"2024-04-25T13:16:50.367333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355175+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:50.355175+0000","last_peered":"2024-04-25T13:16:50.355175+0000","last_clean":"2024-04-25T13:16:50.355175+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:50.355175+0000","last_undegraded":"2024-04-25T13:16:50.355175+0000","last_fullsized":"2024-04-25T13:16:50.355175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391164+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:17:02.391164+0000","last_peered":"2024-04-25T13:17:02.391164+0000","last_clean":"2024-04-25T13:17:02.391164+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:17:02.391164+0000","last_undegraded":"2024-04-25T13:17:02.391164+0000","last_fullsized":"2024-04-25T13:17:02.391164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368422+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:50.368422+0000","last_peered":"2024-04-25T13:16:50.368422+0000","last_clean":"2024-04-25T13:16:50.368422+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:50.368422+0000","last_undegraded":"2024-04-25T13:16:50.368422+0000","last_fullsized":"2024-04-25T13:16:50.368422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354866+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:50.354866+0000","last_peered":"2024-04-25T13:16:50.354866+0000","last_clean":"2024-04-25T13:16:50.354866+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:50.354866+0000","last_undegraded":"2024-04-25T13:16:50.354866+0000","last_fullsized":"2024-04-25T13:16:50.354866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356746+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:50.356746+0000","last_peered":"2024-04-25T13:16:50.356746+0000","last_clean":"2024-04-25T13:16:50.356746+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:50.356746+0000","last_undegraded":"2024-04-25T13:16:50.356746+0000","last_fullsized":"2024-04-25T13:16:50.356746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355245+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:50.355245+0000","last_peered":"2024-04-25T13:16:50.355245+0000","last_clean":"2024-04-25T13:16:50.355245+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:50.355245+0000","last_undegraded":"2024-04-25T13:16:50.355245+0000","last_fullsized":"2024-04-25T13:16:50.355245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355580+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:50.355580+0000","last_peered":"2024-04-25T13:16:50.355580+0000","last_clean":"2024-04-25T13:16:50.355580+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:50.355580+0000","last_undegraded":"2024-04-25T13:16:50.355580+0000","last_fullsized":"2024-04-25T13:16:50.355580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.359349+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:50.359349+0000","last_peered":"2024-04-25T13:16:50.359349+0000","last_clean":"2024-04-25T13:16:50.359349+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:50.359349+0000","last_undegraded":"2024-04-25T13:16:50.359349+0000","last_fullsized":"2024-04-25T13:16:50.359349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377123+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:56.377123+0000","last_peered":"2024-04-25T13:16:56.377123+0000","last_clean":"2024-04-25T13:16:56.377123+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:56.377123+0000","last_undegraded":"2024-04-25T13:16:56.377123+0000","last_fullsized":"2024-04-25T13:16:56.377123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.370263+0000","last_change":"2024-04-25T13:16:50.370263+0000","last_active":"2024-04-25T13:16:50.370263+0000","last_peered":"2024-04-25T13:16:50.370263+0000","last_clean":"2024-04-25T13:16:50.370263+0000","last_became_active":"2024-04-25T13:16:50.369812+0000","last_became_peered":"2024-04-25T13:16:50.369812+0000","last_unstale":"2024-04-25T13:16:50.370263+0000","last_undegraded":"2024-04-25T13:16:50.370263+0000","last_fullsized":"2024-04-25T13:16:50.370263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:03.168762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356486+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:50.356486+0000","last_peered":"2024-04-25T13:16:50.356486+0000","last_clean":"2024-04-25T13:16:50.356486+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:50.356486+0000","last_undegraded":"2024-04-25T13:16:50.356486+0000","last_fullsized":"2024-04-25T13:16:50.356486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.986821+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:17:02.986821+0000","last_peered":"2024-04-25T13:17:02.986821+0000","last_clean":"2024-04-25T13:17:02.986821+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:17:02.986821+0000","last_undegraded":"2024-04-25T13:17:02.986821+0000","last_fullsized":"2024-04-25T13:17:02.986821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363856+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:50.363856+0000","last_peered":"2024-04-25T13:16:50.363856+0000","last_clean":"2024-04-25T13:16:50.363856+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:50.363856+0000","last_undegraded":"2024-04-25T13:16:50.363856+0000","last_fullsized":"2024-04-25T13:16:50.363856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355128+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:50.355128+0000","last_peered":"2024-04-25T13:16:50.355128+0000","last_clean":"2024-04-25T13:16:50.355128+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:50.355128+0000","last_undegraded":"2024-04-25T13:16:50.355128+0000","last_fullsized":"2024-04-25T13:16:50.355128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354149+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:50.354149+0000","last_peered":"2024-04-25T13:16:50.354149+0000","last_clean":"2024-04-25T13:16:50.354149+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:50.354149+0000","last_undegraded":"2024-04-25T13:16:50.354149+0000","last_fullsized":"2024-04-25T13:16:50.354149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355790+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:50.355790+0000","last_peered":"2024-04-25T13:16:50.355790+0000","last_clean":"2024-04-25T13:16:50.355790+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:50.355790+0000","last_undegraded":"2024-04-25T13:16:50.355790+0000","last_fullsized":"2024-04-25T13:16:50.355790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362945+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:50.362945+0000","last_peered":"2024-04-25T13:16:50.362945+0000","last_clean":"2024-04-25T13:16:50.362945+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:50.362945+0000","last_undegraded":"2024-04-25T13:16:50.362945+0000","last_fullsized":"2024-04-25T13:16:50.362945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:07.387828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.390990+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:17:02.390990+0000","last_peered":"2024-04-25T13:17:02.390990+0000","last_clean":"2024-04-25T13:17:02.390990+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:17:02.390990+0000","last_undegraded":"2024-04-25T13:17:02.390990+0000","last_fullsized":"2024-04-25T13:17:02.390990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354770+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:50.354770+0000","last_peered":"2024-04-25T13:16:50.354770+0000","last_clean":"2024-04-25T13:16:50.354770+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:50.354770+0000","last_undegraded":"2024-04-25T13:16:50.354770+0000","last_fullsized":"2024-04-25T13:16:50.354770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357314+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:50.357314+0000","last_peered":"2024-04-25T13:16:50.357314+0000","last_clean":"2024-04-25T13:16:50.357314+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:50.357314+0000","last_undegraded":"2024-04-25T13:16:50.357314+0000","last_fullsized":"2024-04-25T13:16:50.357314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377315+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:56.377315+0000","last_peered":"2024-04-25T13:16:56.377315+0000","last_clean":"2024-04-25T13:16:56.377315+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:56.377315+0000","last_undegraded":"2024-04-25T13:16:56.377315+0000","last_fullsized":"2024-04-25T13:16:56.377315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355824+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:50.355824+0000","last_peered":"2024-04-25T13:16:50.355824+0000","last_clean":"2024-04-25T13:16:50.355824+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:50.355824+0000","last_undegraded":"2024-04-25T13:16:50.355824+0000","last_fullsized":"2024-04-25T13:16:50.355824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364127+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:50.364127+0000","last_peered":"2024-04-25T13:16:50.364127+0000","last_clean":"2024-04-25T13:16:50.364127+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:50.364127+0000","last_undegraded":"2024-04-25T13:16:50.364127+0000","last_fullsized":"2024-04-25T13:16:50.364127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377941+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:56.377941+0000","last_peered":"2024-04-25T13:16:56.377941+0000","last_clean":"2024-04-25T13:16:56.377941+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:56.377941+0000","last_undegraded":"2024-04-25T13:16:56.377941+0000","last_fullsized":"2024-04-25T13:16:56.377941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363869+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:50.363869+0000","last_peered":"2024-04-25T13:16:50.363869+0000","last_clean":"2024-04-25T13:16:50.363869+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:50.363869+0000","last_undegraded":"2024-04-25T13:16:50.363869+0000","last_fullsized":"2024-04-25T13:16:50.363869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:52.881166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368468+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:50.368468+0000","last_peered":"2024-04-25T13:16:50.368468+0000","last_clean":"2024-04-25T13:16:50.368468+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.368468+0000","last_undegraded":"2024-04-25T13:16:50.368468+0000","last_fullsized":"2024-04-25T13:16:50.368468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364301+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:50.364301+0000","last_peered":"2024-04-25T13:16:50.364301+0000","last_clean":"2024-04-25T13:16:50.364301+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:50.364301+0000","last_undegraded":"2024-04-25T13:16:50.364301+0000","last_fullsized":"2024-04-25T13:16:50.364301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364120+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:50.364120+0000","last_peered":"2024-04-25T13:16:50.364120+0000","last_clean":"2024-04-25T13:16:50.364120+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:50.364120+0000","last_undegraded":"2024-04-25T13:16:50.364120+0000","last_fullsized":"2024-04-25T13:16:50.364120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355530+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:50.355530+0000","last_peered":"2024-04-25T13:16:50.355530+0000","last_clean":"2024-04-25T13:16:50.355530+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:50.355530+0000","last_undegraded":"2024-04-25T13:16:50.355530+0000","last_fullsized":"2024-04-25T13:16:50.355530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388455+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:17:02.388455+0000","last_peered":"2024-04-25T13:17:02.388455+0000","last_clean":"2024-04-25T13:17:02.388455+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:17:02.388455+0000","last_undegraded":"2024-04-25T13:17:02.388455+0000","last_fullsized":"2024-04-25T13:17:02.388455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363511+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:50.363511+0000","last_peered":"2024-04-25T13:16:50.363511+0000","last_clean":"2024-04-25T13:16:50.363511+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:50.363511+0000","last_undegraded":"2024-04-25T13:16:50.363511+0000","last_fullsized":"2024-04-25T13:16:50.363511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364360+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:50.364360+0000","last_peered":"2024-04-25T13:16:50.364360+0000","last_clean":"2024-04-25T13:16:50.364360+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:50.364360+0000","last_undegraded":"2024-04-25T13:16:50.364360+0000","last_fullsized":"2024-04-25T13:16:50.364360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.386945+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:17:02.386945+0000","last_peered":"2024-04-25T13:17:02.386945+0000","last_clean":"2024-04-25T13:17:02.386945+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:17:02.386945+0000","last_undegraded":"2024-04-25T13:17:02.386945+0000","last_fullsized":"2024-04-25T13:17:02.386945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364118+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:50.364118+0000","last_peered":"2024-04-25T13:16:50.364118+0000","last_clean":"2024-04-25T13:16:50.364118+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:50.364118+0000","last_undegraded":"2024-04-25T13:16:50.364118+0000","last_fullsized":"2024-04-25T13:16:50.364118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364094+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:50.364094+0000","last_peered":"2024-04-25T13:16:50.364094+0000","last_clean":"2024-04-25T13:16:50.364094+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:50.364094+0000","last_undegraded":"2024-04-25T13:16:50.364094+0000","last_fullsized":"2024-04-25T13:16:50.364094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:14.197407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365277+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:50.365277+0000","last_peered":"2024-04-25T13:16:50.365277+0000","last_clean":"2024-04-25T13:16:50.365277+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:50.365277+0000","last_undegraded":"2024-04-25T13:16:50.365277+0000","last_fullsized":"2024-04-25T13:16:50.365277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362705+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:50.362705+0000","last_peered":"2024-04-25T13:16:50.362705+0000","last_clean":"2024-04-25T13:16:50.362705+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:50.362705+0000","last_undegraded":"2024-04-25T13:16:50.362705+0000","last_fullsized":"2024-04-25T13:16:50.362705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:00.494861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.373995+0000","last_change":"2024-04-25T13:16:50.373995+0000","last_active":"2024-04-25T13:16:50.373995+0000","last_peered":"2024-04-25T13:16:50.373995+0000","last_clean":"2024-04-25T13:16:50.373995+0000","last_became_active":"2024-04-25T13:16:50.373669+0000","last_became_peered":"2024-04-25T13:16:50.373669+0000","last_unstale":"2024-04-25T13:16:50.373995+0000","last_undegraded":"2024-04-25T13:16:50.373995+0000","last_fullsized":"2024-04-25T13:16:50.373995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:28.967657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376971+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:56.376971+0000","last_peered":"2024-04-25T13:16:56.376971+0000","last_clean":"2024-04-25T13:16:56.376971+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:56.376971+0000","last_undegraded":"2024-04-25T13:16:56.376971+0000","last_fullsized":"2024-04-25T13:16:56.376971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354328+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:50.354328+0000","last_peered":"2024-04-25T13:16:50.354328+0000","last_clean":"2024-04-25T13:16:50.354328+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:50.354328+0000","last_undegraded":"2024-04-25T13:16:50.354328+0000","last_fullsized":"2024-04-25T13:16:50.354328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357049+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:50.357049+0000","last_peered":"2024-04-25T13:16:50.357049+0000","last_clean":"2024-04-25T13:16:50.357049+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:50.357049+0000","last_undegraded":"2024-04-25T13:16:50.357049+0000","last_fullsized":"2024-04-25T13:16:50.357049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365712+0000","last_change":"2024-04-25T13:16:50.365712+0000","last_active":"2024-04-25T13:16:50.365712+0000","last_peered":"2024-04-25T13:16:50.365712+0000","last_clean":"2024-04-25T13:16:50.365712+0000","last_became_active":"2024-04-25T13:16:50.365465+0000","last_became_peered":"2024-04-25T13:16:50.365465+0000","last_unstale":"2024-04-25T13:16:50.365712+0000","last_undegraded":"2024-04-25T13:16:50.365712+0000","last_fullsized":"2024-04-25T13:16:50.365712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:02.718759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.778414+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:17:10.778414+0000","last_peered":"2024-04-25T13:17:10.778414+0000","last_clean":"2024-04-25T13:17:10.778414+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:17:10.778414+0000","last_undegraded":"2024-04-25T13:17:10.778414+0000","last_fullsized":"2024-04-25T13:17:10.778414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368982+0000","last_change":"2024-04-25T13:16:50.368982+0000","last_active":"2024-04-25T13:16:50.368982+0000","last_peered":"2024-04-25T13:16:50.368982+0000","last_clean":"2024-04-25T13:16:50.368982+0000","last_became_active":"2024-04-25T13:16:50.368538+0000","last_became_peered":"2024-04-25T13:16:50.368538+0000","last_unstale":"2024-04-25T13:16:50.368982+0000","last_undegraded":"2024-04-25T13:16:50.368982+0000","last_fullsized":"2024-04-25T13:16:50.368982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:47.805583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367386+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:50.367386+0000","last_peered":"2024-04-25T13:16:50.367386+0000","last_clean":"2024-04-25T13:16:50.367386+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:50.367386+0000","last_undegraded":"2024-04-25T13:16:50.367386+0000","last_fullsized":"2024-04-25T13:16:50.367386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377057+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:56.377057+0000","last_peered":"2024-04-25T13:16:56.377057+0000","last_clean":"2024-04-25T13:16:56.377057+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:56.377057+0000","last_undegraded":"2024-04-25T13:16:56.377057+0000","last_fullsized":"2024-04-25T13:16:56.377057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364093+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:50.364093+0000","last_peered":"2024-04-25T13:16:50.364093+0000","last_clean":"2024-04-25T13:16:50.364093+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:50.364093+0000","last_undegraded":"2024-04-25T13:16:50.364093+0000","last_fullsized":"2024-04-25T13:16:50.364093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:35.815826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355622+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:50.355622+0000","last_peered":"2024-04-25T13:16:50.355622+0000","last_clean":"2024-04-25T13:16:50.355622+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:50.355622+0000","last_undegraded":"2024-04-25T13:16:50.355622+0000","last_fullsized":"2024-04-25T13:16:50.355622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.385844+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:17:02.385844+0000","last_peered":"2024-04-25T13:17:02.385844+0000","last_clean":"2024-04-25T13:17:02.385844+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:17:02.385844+0000","last_undegraded":"2024-04-25T13:17:02.385844+0000","last_fullsized":"2024-04-25T13:17:02.385844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366656+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:50.366656+0000","last_peered":"2024-04-25T13:16:50.366656+0000","last_clean":"2024-04-25T13:16:50.366656+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:50.366656+0000","last_undegraded":"2024-04-25T13:16:50.366656+0000","last_fullsized":"2024-04-25T13:16:50.366656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354864+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:50.354864+0000","last_peered":"2024-04-25T13:16:50.354864+0000","last_clean":"2024-04-25T13:16:50.354864+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:50.354864+0000","last_undegraded":"2024-04-25T13:16:50.354864+0000","last_fullsized":"2024-04-25T13:16:50.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356040+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:50.356040+0000","last_peered":"2024-04-25T13:16:50.356040+0000","last_clean":"2024-04-25T13:16:50.356040+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:50.356040+0000","last_undegraded":"2024-04-25T13:16:50.356040+0000","last_fullsized":"2024-04-25T13:16:50.356040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354663+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:50.354663+0000","last_peered":"2024-04-25T13:16:50.354663+0000","last_clean":"2024-04-25T13:16:50.354663+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:50.354663+0000","last_undegraded":"2024-04-25T13:16:50.354663+0000","last_fullsized":"2024-04-25T13:16:50.354663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354424+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:50.354424+0000","last_peered":"2024-04-25T13:16:50.354424+0000","last_clean":"2024-04-25T13:16:50.354424+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:50.354424+0000","last_undegraded":"2024-04-25T13:16:50.354424+0000","last_fullsized":"2024-04-25T13:16:50.354424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377581+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:56.377581+0000","last_peered":"2024-04-25T13:16:56.377581+0000","last_clean":"2024-04-25T13:16:56.377581+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:56.377581+0000","last_undegraded":"2024-04-25T13:16:56.377581+0000","last_fullsized":"2024-04-25T13:16:56.377581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362572+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:50.362572+0000","last_peered":"2024-04-25T13:16:50.362572+0000","last_clean":"2024-04-25T13:16:50.362572+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:50.362572+0000","last_undegraded":"2024-04-25T13:16:50.362572+0000","last_fullsized":"2024-04-25T13:16:50.362572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:15.310573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356614+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:50.356614+0000","last_peered":"2024-04-25T13:16:50.356614+0000","last_clean":"2024-04-25T13:16:50.356614+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:50.356614+0000","last_undegraded":"2024-04-25T13:16:50.356614+0000","last_fullsized":"2024-04-25T13:16:50.356614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.783746+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:17:10.783746+0000","last_peered":"2024-04-25T13:17:10.783746+0000","last_clean":"2024-04-25T13:17:10.783746+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:17:10.783746+0000","last_undegraded":"2024-04-25T13:17:10.783746+0000","last_fullsized":"2024-04-25T13:17:10.783746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357157+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:50.357157+0000","last_peered":"2024-04-25T13:16:50.357157+0000","last_clean":"2024-04-25T13:16:50.357157+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:50.357157+0000","last_undegraded":"2024-04-25T13:16:50.357157+0000","last_fullsized":"2024-04-25T13:16:50.357157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355199+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:50.355199+0000","last_peered":"2024-04-25T13:16:50.355199+0000","last_clean":"2024-04-25T13:16:50.355199+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:50.355199+0000","last_undegraded":"2024-04-25T13:16:50.355199+0000","last_fullsized":"2024-04-25T13:16:50.355199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376519+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:56.376519+0000","last_peered":"2024-04-25T13:16:56.376519+0000","last_clean":"2024-04-25T13:16:56.376519+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:56.376519+0000","last_undegraded":"2024-04-25T13:16:56.376519+0000","last_fullsized":"2024-04-25T13:16:56.376519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.358023+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:50.358023+0000","last_peered":"2024-04-25T13:16:50.358023+0000","last_clean":"2024-04-25T13:16:50.358023+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:50.358023+0000","last_undegraded":"2024-04-25T13:16:50.358023+0000","last_fullsized":"2024-04-25T13:16:50.358023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362160+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:50.362160+0000","last_peered":"2024-04-25T13:16:50.362160+0000","last_clean":"2024-04-25T13:16:50.362160+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:50.362160+0000","last_undegraded":"2024-04-25T13:16:50.362160+0000","last_fullsized":"2024-04-25T13:16:50.362160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:24.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.386036+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:17:02.386036+0000","last_peered":"2024-04-25T13:17:02.386036+0000","last_clean":"2024-04-25T13:17:02.386036+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:17:02.386036+0000","last_undegraded":"2024-04-25T13:17:02.386036+0000","last_fullsized":"2024-04-25T13:17:02.386036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:49.859293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368372+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:50.368372+0000","last_peered":"2024-04-25T13:16:50.368372+0000","last_clean":"2024-04-25T13:16:50.368372+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:50.368372+0000","last_undegraded":"2024-04-25T13:16:50.368372+0000","last_fullsized":"2024-04-25T13:16:50.368372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355360+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:50.355360+0000","last_peered":"2024-04-25T13:16:50.355360+0000","last_clean":"2024-04-25T13:16:50.355360+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:50.355360+0000","last_undegraded":"2024-04-25T13:16:50.355360+0000","last_fullsized":"2024-04-25T13:16:50.355360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.988017+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:17:10.988017+0000","last_peered":"2024-04-25T13:17:10.988017+0000","last_clean":"2024-04-25T13:17:10.988017+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:17:10.988017+0000","last_undegraded":"2024-04-25T13:17:10.988017+0000","last_fullsized":"2024-04-25T13:17:10.988017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364968+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:50.364968+0000","last_peered":"2024-04-25T13:16:50.364968+0000","last_clean":"2024-04-25T13:16:50.364968+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:50.364968+0000","last_undegraded":"2024-04-25T13:16:50.364968+0000","last_fullsized":"2024-04-25T13:16:50.364968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355772+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:50.355772+0000","last_peered":"2024-04-25T13:16:50.355772+0000","last_clean":"2024-04-25T13:16:50.355772+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:50.355772+0000","last_undegraded":"2024-04-25T13:16:50.355772+0000","last_fullsized":"2024-04-25T13:16:50.355772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364593+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:50.364593+0000","last_peered":"2024-04-25T13:16:50.364593+0000","last_clean":"2024-04-25T13:16:50.364593+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:50.364593+0000","last_undegraded":"2024-04-25T13:16:50.364593+0000","last_fullsized":"2024-04-25T13:16:50.364593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355323+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:50.355323+0000","last_peered":"2024-04-25T13:16:50.355323+0000","last_clean":"2024-04-25T13:16:50.355323+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:50.355323+0000","last_undegraded":"2024-04-25T13:16:50.355323+0000","last_fullsized":"2024-04-25T13:16:50.355323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363727+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:50.363727+0000","last_peered":"2024-04-25T13:16:50.363727+0000","last_clean":"2024-04-25T13:16:50.363727+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:50.363727+0000","last_undegraded":"2024-04-25T13:16:50.363727+0000","last_fullsized":"2024-04-25T13:16:50.363727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:59.519018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391208+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:17:02.391208+0000","last_peered":"2024-04-25T13:17:02.391208+0000","last_clean":"2024-04-25T13:17:02.391208+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:17:02.391208+0000","last_undegraded":"2024-04-25T13:17:02.391208+0000","last_fullsized":"2024-04-25T13:17:02.391208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356204+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:50.356204+0000","last_peered":"2024-04-25T13:16:50.356204+0000","last_clean":"2024-04-25T13:16:50.356204+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:50.356204+0000","last_undegraded":"2024-04-25T13:16:50.356204+0000","last_fullsized":"2024-04-25T13:16:50.356204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367495+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:50.367495+0000","last_peered":"2024-04-25T13:16:50.367495+0000","last_clean":"2024-04-25T13:16:50.367495+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:50.367495+0000","last_undegraded":"2024-04-25T13:16:50.367495+0000","last_fullsized":"2024-04-25T13:16:50.367495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781217+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:17:10.781217+0000","last_peered":"2024-04-25T13:17:10.781217+0000","last_clean":"2024-04-25T13:17:10.781217+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:17:10.781217+0000","last_undegraded":"2024-04-25T13:17:10.781217+0000","last_fullsized":"2024-04-25T13:17:10.781217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355305+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:50.355305+0000","last_peered":"2024-04-25T13:16:50.355305+0000","last_clean":"2024-04-25T13:16:50.355305+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:50.355305+0000","last_undegraded":"2024-04-25T13:16:50.355305+0000","last_fullsized":"2024-04-25T13:16:50.355305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362452+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:50.362452+0000","last_peered":"2024-04-25T13:16:50.362452+0000","last_clean":"2024-04-25T13:16:50.362452+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:50.362452+0000","last_undegraded":"2024-04-25T13:16:50.362452+0000","last_fullsized":"2024-04-25T13:16:50.362452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.475502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363321+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:50.363321+0000","last_peered":"2024-04-25T13:16:50.363321+0000","last_clean":"2024-04-25T13:16:50.363321+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:50.363321+0000","last_undegraded":"2024-04-25T13:16:50.363321+0000","last_fullsized":"2024-04-25T13:16:50.363321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376012+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:56.376012+0000","last_peered":"2024-04-25T13:16:56.376012+0000","last_clean":"2024-04-25T13:16:56.376012+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:56.376012+0000","last_undegraded":"2024-04-25T13:16:56.376012+0000","last_fullsized":"2024-04-25T13:16:56.376012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357030+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:50.357030+0000","last_peered":"2024-04-25T13:16:50.357030+0000","last_clean":"2024-04-25T13:16:50.357030+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:50.357030+0000","last_undegraded":"2024-04-25T13:16:50.357030+0000","last_fullsized":"2024-04-25T13:16:50.357030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372604+0000","last_change":"2024-04-25T13:16:50.370489+0000","last_active":"2024-04-25T13:16:50.372604+0000","last_peered":"2024-04-25T13:16:50.372604+0000","last_clean":"2024-04-25T13:16:50.372604+0000","last_became_active":"2024-04-25T13:16:50.370143+0000","last_became_peered":"2024-04-25T13:16:50.370143+0000","last_unstale":"2024-04-25T13:16:50.372604+0000","last_undegraded":"2024-04-25T13:16:50.372604+0000","last_fullsized":"2024-04-25T13:16:50.372604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:06.845107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365416+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:50.365416+0000","last_peered":"2024-04-25T13:16:50.365416+0000","last_clean":"2024-04-25T13:16:50.365416+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:50.365416+0000","last_undegraded":"2024-04-25T13:16:50.365416+0000","last_fullsized":"2024-04-25T13:16:50.365416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376785+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:56.376785+0000","last_peered":"2024-04-25T13:16:56.376785+0000","last_clean":"2024-04-25T13:16:56.376785+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:56.376785+0000","last_undegraded":"2024-04-25T13:16:56.376785+0000","last_fullsized":"2024-04-25T13:16:56.376785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364240+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:50.364240+0000","last_peered":"2024-04-25T13:16:50.364240+0000","last_clean":"2024-04-25T13:16:50.364240+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:50.364240+0000","last_undegraded":"2024-04-25T13:16:50.364240+0000","last_fullsized":"2024-04-25T13:16:50.364240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366699+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:50.366699+0000","last_peered":"2024-04-25T13:16:50.366699+0000","last_clean":"2024-04-25T13:16:50.366699+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:50.366699+0000","last_undegraded":"2024-04-25T13:16:50.366699+0000","last_fullsized":"2024-04-25T13:16:50.366699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781407+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:17:10.781407+0000","last_peered":"2024-04-25T13:17:10.781407+0000","last_clean":"2024-04-25T13:17:10.781407+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:17:10.781407+0000","last_undegraded":"2024-04-25T13:17:10.781407+0000","last_fullsized":"2024-04-25T13:17:10.781407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356066+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:50.356066+0000","last_peered":"2024-04-25T13:16:50.356066+0000","last_clean":"2024-04-25T13:16:50.356066+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:50.356066+0000","last_undegraded":"2024-04-25T13:16:50.356066+0000","last_fullsized":"2024-04-25T13:16:50.356066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357602+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:50.357602+0000","last_peered":"2024-04-25T13:16:50.357602+0000","last_clean":"2024-04-25T13:16:50.357602+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:50.357602+0000","last_undegraded":"2024-04-25T13:16:50.357602+0000","last_fullsized":"2024-04-25T13:16:50.357602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356114+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:50.356114+0000","last_peered":"2024-04-25T13:16:50.356114+0000","last_clean":"2024-04-25T13:16:50.356114+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:50.356114+0000","last_undegraded":"2024-04-25T13:16:50.356114+0000","last_fullsized":"2024-04-25T13:16:50.356114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366795+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:50.366795+0000","last_peered":"2024-04-25T13:16:50.366795+0000","last_clean":"2024-04-25T13:16:50.366795+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:50.366795+0000","last_undegraded":"2024-04-25T13:16:50.366795+0000","last_fullsized":"2024-04-25T13:16:50.366795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366978+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:50.366978+0000","last_peered":"2024-04-25T13:16:50.366978+0000","last_clean":"2024-04-25T13:16:50.366978+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:50.366978+0000","last_undegraded":"2024-04-25T13:16:50.366978+0000","last_fullsized":"2024-04-25T13:16:50.366978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364140+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:50.364140+0000","last_peered":"2024-04-25T13:16:50.364140+0000","last_clean":"2024-04-25T13:16:50.364140+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:50.364140+0000","last_undegraded":"2024-04-25T13:16:50.364140+0000","last_fullsized":"2024-04-25T13:16:50.364140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:23.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372415+0000","last_change":"2024-04-25T13:16:50.369947+0000","last_active":"2024-04-25T13:16:50.372415+0000","last_peered":"2024-04-25T13:16:50.372415+0000","last_clean":"2024-04-25T13:16:50.372415+0000","last_became_active":"2024-04-25T13:16:50.369437+0000","last_became_peered":"2024-04-25T13:16:50.369437+0000","last_unstale":"2024-04-25T13:16:50.372415+0000","last_undegraded":"2024-04-25T13:16:50.372415+0000","last_fullsized":"2024-04-25T13:16:50.372415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:26.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363154+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:50.363154+0000","last_peered":"2024-04-25T13:16:50.363154+0000","last_clean":"2024-04-25T13:16:50.363154+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:50.363154+0000","last_undegraded":"2024-04-25T13:16:50.363154+0000","last_fullsized":"2024-04-25T13:16:50.363154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357306+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:50.357306+0000","last_peered":"2024-04-25T13:16:50.357306+0000","last_clean":"2024-04-25T13:16:50.357306+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:50.357306+0000","last_undegraded":"2024-04-25T13:16:50.357306+0000","last_fullsized":"2024-04-25T13:16:50.357306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357159+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:50.357159+0000","last_peered":"2024-04-25T13:16:50.357159+0000","last_clean":"2024-04-25T13:16:50.357159+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:50.357159+0000","last_undegraded":"2024-04-25T13:16:50.357159+0000","last_fullsized":"2024-04-25T13:16:50.357159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366748+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:50.366748+0000","last_peered":"2024-04-25T13:16:50.366748+0000","last_clean":"2024-04-25T13:16:50.366748+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:50.366748+0000","last_undegraded":"2024-04-25T13:16:50.366748+0000","last_fullsized":"2024-04-25T13:16:50.366748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355469+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:50.355469+0000","last_peered":"2024-04-25T13:16:50.355469+0000","last_clean":"2024-04-25T13:16:50.355469+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:50.355469+0000","last_undegraded":"2024-04-25T13:16:50.355469+0000","last_fullsized":"2024-04-25T13:16:50.355469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366885+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:50.366885+0000","last_peered":"2024-04-25T13:16:50.366885+0000","last_clean":"2024-04-25T13:16:50.366885+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:50.366885+0000","last_undegraded":"2024-04-25T13:16:50.366885+0000","last_fullsized":"2024-04-25T13:16:50.366885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363969+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:50.363969+0000","last_peered":"2024-04-25T13:16:50.363969+0000","last_clean":"2024-04-25T13:16:50.363969+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:50.363969+0000","last_undegraded":"2024-04-25T13:16:50.363969+0000","last_fullsized":"2024-04-25T13:16:50.363969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:52.980650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357173+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:50.357173+0000","last_peered":"2024-04-25T13:16:50.357173+0000","last_clean":"2024-04-25T13:16:50.357173+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:50.357173+0000","last_undegraded":"2024-04-25T13:16:50.357173+0000","last_fullsized":"2024-04-25T13:16:50.357173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355881+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:50.355881+0000","last_peered":"2024-04-25T13:16:50.355881+0000","last_clean":"2024-04-25T13:16:50.355881+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:50.355881+0000","last_undegraded":"2024-04-25T13:16:50.355881+0000","last_fullsized":"2024-04-25T13:16:50.355881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366734+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:50.366734+0000","last_peered":"2024-04-25T13:16:50.366734+0000","last_clean":"2024-04-25T13:16:50.366734+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:50.366734+0000","last_undegraded":"2024-04-25T13:16:50.366734+0000","last_fullsized":"2024-04-25T13:16:50.366734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367697+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:50.367697+0000","last_peered":"2024-04-25T13:16:50.367697+0000","last_clean":"2024-04-25T13:16:50.367697+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:50.367697+0000","last_undegraded":"2024-04-25T13:16:50.367697+0000","last_fullsized":"2024-04-25T13:16:50.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366727+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:50.366727+0000","last_peered":"2024-04-25T13:16:50.366727+0000","last_clean":"2024-04-25T13:16:50.366727+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:50.366727+0000","last_undegraded":"2024-04-25T13:16:50.366727+0000","last_fullsized":"2024-04-25T13:16:50.366727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363431+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:50.363431+0000","last_peered":"2024-04-25T13:16:50.363431+0000","last_clean":"2024-04-25T13:16:50.363431+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:50.363431+0000","last_undegraded":"2024-04-25T13:16:50.363431+0000","last_fullsized":"2024-04-25T13:16:50.363431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362040+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:50.362040+0000","last_peered":"2024-04-25T13:16:50.362040+0000","last_clean":"2024-04-25T13:16:50.362040+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:50.362040+0000","last_undegraded":"2024-04-25T13:16:50.362040+0000","last_fullsized":"2024-04-25T13:16:50.362040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:44.821443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356705+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:50.356705+0000","last_peered":"2024-04-25T13:16:50.356705+0000","last_clean":"2024-04-25T13:16:50.356705+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:50.356705+0000","last_undegraded":"2024-04-25T13:16:50.356705+0000","last_fullsized":"2024-04-25T13:16:50.356705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355690+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:50.355690+0000","last_peered":"2024-04-25T13:16:50.355690+0000","last_clean":"2024-04-25T13:16:50.355690+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:50.355690+0000","last_undegraded":"2024-04-25T13:16:50.355690+0000","last_fullsized":"2024-04-25T13:16:50.355690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357158+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:50.357158+0000","last_peered":"2024-04-25T13:16:50.357158+0000","last_clean":"2024-04-25T13:16:50.357158+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.357158+0000","last_undegraded":"2024-04-25T13:16:50.357158+0000","last_fullsized":"2024-04-25T13:16:50.357158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357282+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:50.357282+0000","last_peered":"2024-04-25T13:16:50.357282+0000","last_clean":"2024-04-25T13:16:50.357282+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:50.357282+0000","last_undegraded":"2024-04-25T13:16:50.357282+0000","last_fullsized":"2024-04-25T13:16:50.357282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365616+0000","last_change":"2024-04-25T13:16:50.365616+0000","last_active":"2024-04-25T13:16:50.365616+0000","last_peered":"2024-04-25T13:16:50.365616+0000","last_clean":"2024-04-25T13:16:50.365616+0000","last_became_active":"2024-04-25T13:16:50.365415+0000","last_became_peered":"2024-04-25T13:16:50.365415+0000","last_unstale":"2024-04-25T13:16:50.365616+0000","last_undegraded":"2024-04-25T13:16:50.365616+0000","last_fullsized":"2024-04-25T13:16:50.365616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:37.667075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356014+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:50.356014+0000","last_peered":"2024-04-25T13:16:50.356014+0000","last_clean":"2024-04-25T13:16:50.356014+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:50.356014+0000","last_undegraded":"2024-04-25T13:16:50.356014+0000","last_fullsized":"2024-04-25T13:16:50.356014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372305+0000","last_change":"2024-04-25T13:16:50.370418+0000","last_active":"2024-04-25T13:16:50.372305+0000","last_peered":"2024-04-25T13:16:50.372305+0000","last_clean":"2024-04-25T13:16:50.372305+0000","last_became_active":"2024-04-25T13:16:50.370066+0000","last_became_peered":"2024-04-25T13:16:50.370066+0000","last_unstale":"2024-04-25T13:16:50.372305+0000","last_undegraded":"2024-04-25T13:16:50.372305+0000","last_fullsized":"2024-04-25T13:16:50.372305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:17.756850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366860+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:50.366860+0000","last_peered":"2024-04-25T13:16:50.366860+0000","last_clean":"2024-04-25T13:16:50.366860+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:50.366860+0000","last_undegraded":"2024-04-25T13:16:50.366860+0000","last_fullsized":"2024-04-25T13:16:50.366860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355061+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:50.355061+0000","last_peered":"2024-04-25T13:16:50.355061+0000","last_clean":"2024-04-25T13:16:50.355061+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:50.355061+0000","last_undegraded":"2024-04-25T13:16:50.355061+0000","last_fullsized":"2024-04-25T13:16:50.355061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367300+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:50.367300+0000","last_peered":"2024-04-25T13:16:50.367300+0000","last_clean":"2024-04-25T13:16:50.367300+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:50.367300+0000","last_undegraded":"2024-04-25T13:16:50.367300+0000","last_fullsized":"2024-04-25T13:16:50.367300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363217+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:50.363217+0000","last_peered":"2024-04-25T13:16:50.363217+0000","last_clean":"2024-04-25T13:16:50.363217+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:50.363217+0000","last_undegraded":"2024-04-25T13:16:50.363217+0000","last_fullsized":"2024-04-25T13:16:50.363217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:51.820664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362907+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:50.362907+0000","last_peered":"2024-04-25T13:16:50.362907+0000","last_clean":"2024-04-25T13:16:50.362907+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:50.362907+0000","last_undegraded":"2024-04-25T13:16:50.362907+0000","last_fullsized":"2024-04-25T13:16:50.362907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355523+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:50.355523+0000","last_peered":"2024-04-25T13:16:50.355523+0000","last_clean":"2024-04-25T13:16:50.355523+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:50.355523+0000","last_undegraded":"2024-04-25T13:16:50.355523+0000","last_fullsized":"2024-04-25T13:16:50.355523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":120093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:23.825 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:17:23.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:23.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.962+0000 7f66f56a3640 1 Processor -- start 2024-04-25T13:17:23.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.962+0000 7f66f56a3640 1 -- start start 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66f56a3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 0x7f66f00d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66f56a3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f01558c0 con 0x7f66f01554e0 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66f56a3640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f00cb8c0 con 0x7f66f00b3c00 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66f56a3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f66f00b4a80 con 0x7f66f00d08a0 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66eeffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f66f01554e0 0x7f66f015f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36796/0 (socket says 172.21.15.26:36796) 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66eeffd640 1 -- 172.21.15.26:0/522585572 learned_addr learned my addr 172.21.15.26:0/522585572 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66ef7fe640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 0x7f66f00d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 896394486 0 0) 0x7f66e0001110 con 0x7f66f01554e0 2024-04-25T13:17:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66d8003520 con 0x7f66f01554e0 2024-04-25T13:17:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1434595892 0 0) 0x7f66d8003520 con 0x7f66f01554e0 2024-04-25T13:17:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 msgr2=0x7f66f00d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 0x7f66f00d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 >> v1:172.21.15.169:6789/0 conn(0x7f66f00b3c00 legacy=0x7f66f00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f00cbba0 con 0x7f66f01554e0 2024-04-25T13:17:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f66e0001840 con 0x7f66f01554e0 2024-04-25T13:17:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 >> v1:172.21.15.26:6789/0 conn(0x7f66f01554e0 legacy=0x7f66f015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.963+0000 7f66edffb640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80039e0 0x7f66d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66edffb640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 0x7f66d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66edffb640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66d8004d40 0x7f66d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66f00b4a80 con 0x7f66d80039e0 2024-04-25T13:17:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66d800bb00 con 0x7f66d8004d40 2024-04-25T13:17:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f66d800bd00 con 0x7f66f00d08a0 2024-04-25T13:17:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66eeffd640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80039e0 0x7f66d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66ee7fc640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 0x7f66d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66ef7fe640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66d8004d40 0x7f66d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66eeffd640 1 -- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 msgr2=0x7f66d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66eeffd640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66f00d08a0 0x7f66d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66eeffd640 1 -- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66d8004d40 msgr2=0x7f66d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66eeffd640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66d8004d40 0x7f66d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.964+0000 7f66eeffd640 1 -- 172.21.15.26:0/522585572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d8003520 con 0x7f66d80039e0 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66eeffd640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80039e0 0x7f66d8003e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66e000c490 tx=0x7f66d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1789c7facf29995a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e000c0e0 con 0x7f66d80039e0 2024-04-25T13:17:23.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e0034070 con 0x7f66d80039e0 2024-04-25T13:17:23.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66edffb640 1 -- 172.21.15.26:0/522585572 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0005d30 con 0x7f66d80039e0 2024-04-25T13:17:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66f56a3640 1 -- 172.21.15.26:0/522585572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80039e0 msgr2=0x7f66d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66f56a3640 1 --2- 172.21.15.26:0/522585572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80039e0 0x7f66d8003e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66e000c490 tx=0x7f66d8005830 comp rx=0 tx=0).stop 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66ef7fe640 1 -- 172.21.15.26:0/522585572 reap_dead start 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66f56a3640 1 -- 172.21.15.26:0/522585572 shutdown_connections 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66f56a3640 1 -- 172.21.15.26:0/522585572 >> 172.21.15.26:0/522585572 conn(0x7f66f0074d50 msgr2=0x7f66f0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66f56a3640 1 -- 172.21.15.26:0/522585572 shutdown_connections 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.965+0000 7f66f56a3640 1 -- 172.21.15.26:0/522585572 wait complete. 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 Processor -- start 2024-04-25T13:17:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 -- start start 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66d80039e0 0x7f66f01f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f015d340 0x7f66f014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66f00c89d0 0x7f66f00ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66f00b4710 con 0x7f66f015d340 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66f00b4430 con 0x7f66f00c89d0 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.967+0000 7f66f56a3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f66f00b3580 con 0x7f66d80039e0 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f015d340 0x7f66f014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f015d340 0x7f66f014f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60274/0 (socket says 172.21.15.26:60274) 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 -- 172.21.15.26:0/4234631183 learned_addr learned my addr 172.21.15.26:0/4234631183 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66eeffd640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66d80039e0 0x7f66f01f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ef7fe640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66f00c89d0 0x7f66f00ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 -- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66d80039e0 msgr2=0x7f66f01f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66d80039e0 0x7f66f01f1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 -- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66f00c89d0 msgr2=0x7f66f00ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66f00c89d0 0x7f66f00ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 -- 172.21.15.26:0/4234631183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f0151180 con 0x7f66f015d340 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66eeffd640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66d80039e0 0x7f66f01f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ef7fe640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66f00c89d0 0x7f66f00ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66ee7fc640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f015d340 0x7f66f014f4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66e400f850 tx=0x7f66e400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66d77fe640 1 -- 172.21.15.26:0/4234631183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e400fe40 con 0x7f66f015d340 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66d77fe640 1 -- 172.21.15.26:0/4234631183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4018070 con 0x7f66f015d340 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66d77fe640 1 -- 172.21.15.26:0/4234631183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e400d6d0 con 0x7f66f015d340 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f00c8e50 con 0x7f66f015d340 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.968+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f015cdf0 con 0x7f66f015d340 2024-04-25T13:17:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.969+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f0069e50 con 0x7f66f015d340 2024-04-25T13:17:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.970+0000 7f66d77fe640 1 -- 172.21.15.26:0/4234631183 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66e400d870 con 0x7f66f015d340 2024-04-25T13:17:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.970+0000 7f66d77fe640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f66dc06c8f0 0x7f66dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.970+0000 7f66d77fe640 1 -- 172.21.15.26:0/4234631183 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f66e408bf00 con 0x7f66f015d340 2024-04-25T13:17:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.971+0000 7f66eeffd640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f66dc06c8f0 0x7f66dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.971+0000 7f66eeffd640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f66dc06c8f0 0x7f66dc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f66d80057e0 tx=0x7f66e002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:23.974+0000 7f66d77fe640 1 -- 172.21.15.26:0/4234631183 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66f0069e50 con 0x7f66f015d340 2024-04-25T13:17:24.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.161+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66f00caf80 con 0x7f66dc06c8f0 2024-04-25T13:17:24.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.169+0000 7f66d77fe640 1 -- 172.21.15.26:0/4234631183 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332628 (secure 0 0 0) 0x7f66e0099370 con 0x7f66dc06c8f0 2024-04-25T13:17:24.173 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:24.174 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:17:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f66dc06c8f0 msgr2=0x7f66dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f66dc06c8f0 0x7f66dc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f66d80057e0 tx=0x7f66e002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f015d340 msgr2=0x7f66f014f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f015d340 0x7f66f014f4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66e400f850 tx=0x7f66e400fd10 comp rx=0 tx=0).stop 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 shutdown_connections 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f66dc06c8f0 0x7f66dc06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66f00c89d0 0x7f66f00ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f015d340 0x7f66f014f4c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 --2- 172.21.15.26:0/4234631183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66d80039e0 0x7f66f01f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 >> 172.21.15.26:0/4234631183 conn(0x7f66f0074d50 msgr2=0x7f66f00cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 shutdown_connections 2024-04-25T13:17:24.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.173+0000 7f66f56a3640 1 -- 172.21.15.26:0/4234631183 wait complete. 2024-04-25T13:17:24.184 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-25T13:17:23.180199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":564,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002742"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388744+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:17:02.388744+0000","last_peered":"2024-04-25T13:17:02.388744+0000","last_clean":"2024-04-25T13:17:02.388744+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:17:02.388744+0000","last_undegraded":"2024-04-25T13:17:02.388744+0000","last_fullsized":"2024-04-25T13:17:02.388744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:27.622324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357827+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:50.357827+0000","last_peered":"2024-04-25T13:16:50.357827+0000","last_clean":"2024-04-25T13:16:50.357827+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:50.357827+0000","last_undegraded":"2024-04-25T13:16:50.357827+0000","last_fullsized":"2024-04-25T13:16:50.357827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355169+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:50.355169+0000","last_peered":"2024-04-25T13:16:50.355169+0000","last_clean":"2024-04-25T13:16:50.355169+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:50.355169+0000","last_undegraded":"2024-04-25T13:16:50.355169+0000","last_fullsized":"2024-04-25T13:16:50.355169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.360171+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:50.360171+0000","last_peered":"2024-04-25T13:16:50.360171+0000","last_clean":"2024-04-25T13:16:50.360171+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:50.360171+0000","last_undegraded":"2024-04-25T13:16:50.360171+0000","last_fullsized":"2024-04-25T13:16:50.360171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363517+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:50.363517+0000","last_peered":"2024-04-25T13:16:50.363517+0000","last_clean":"2024-04-25T13:16:50.363517+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:50.363517+0000","last_undegraded":"2024-04-25T13:16:50.363517+0000","last_fullsized":"2024-04-25T13:16:50.363517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:07.806920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362029+0000","last_change":"2024-04-25T13:16:50.362029+0000","last_active":"2024-04-25T13:16:50.362029+0000","last_peered":"2024-04-25T13:16:50.362029+0000","last_clean":"2024-04-25T13:16:50.362029+0000","last_became_active":"2024-04-25T13:16:50.361435+0000","last_became_peered":"2024-04-25T13:16:50.361435+0000","last_unstale":"2024-04-25T13:16:50.362029+0000","last_undegraded":"2024-04-25T13:16:50.362029+0000","last_fullsized":"2024-04-25T13:16:50.362029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:46.962760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391259+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:17:02.391259+0000","last_peered":"2024-04-25T13:17:02.391259+0000","last_clean":"2024-04-25T13:17:02.391259+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:17:02.391259+0000","last_undegraded":"2024-04-25T13:17:02.391259+0000","last_fullsized":"2024-04-25T13:17:02.391259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367333+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:50.367333+0000","last_peered":"2024-04-25T13:16:50.367333+0000","last_clean":"2024-04-25T13:16:50.367333+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:50.367333+0000","last_undegraded":"2024-04-25T13:16:50.367333+0000","last_fullsized":"2024-04-25T13:16:50.367333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355175+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:50.355175+0000","last_peered":"2024-04-25T13:16:50.355175+0000","last_clean":"2024-04-25T13:16:50.355175+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:50.355175+0000","last_undegraded":"2024-04-25T13:16:50.355175+0000","last_fullsized":"2024-04-25T13:16:50.355175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391164+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:17:02.391164+0000","last_peered":"2024-04-25T13:17:02.391164+0000","last_clean":"2024-04-25T13:17:02.391164+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:17:02.391164+0000","last_undegraded":"2024-04-25T13:17:02.391164+0000","last_fullsized":"2024-04-25T13:17:02.391164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368422+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:50.368422+0000","last_peered":"2024-04-25T13:16:50.368422+0000","last_clean":"2024-04-25T13:16:50.368422+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:50.368422+0000","last_undegraded":"2024-04-25T13:16:50.368422+0000","last_fullsized":"2024-04-25T13:16:50.368422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354866+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:50.354866+0000","last_peered":"2024-04-25T13:16:50.354866+0000","last_clean":"2024-04-25T13:16:50.354866+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:50.354866+0000","last_undegraded":"2024-04-25T13:16:50.354866+0000","last_fullsized":"2024-04-25T13:16:50.354866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356746+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:50.356746+0000","last_peered":"2024-04-25T13:16:50.356746+0000","last_clean":"2024-04-25T13:16:50.356746+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:50.356746+0000","last_undegraded":"2024-04-25T13:16:50.356746+0000","last_fullsized":"2024-04-25T13:16:50.356746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355245+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:50.355245+0000","last_peered":"2024-04-25T13:16:50.355245+0000","last_clean":"2024-04-25T13:16:50.355245+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:50.355245+0000","last_undegraded":"2024-04-25T13:16:50.355245+0000","last_fullsized":"2024-04-25T13:16:50.355245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355580+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:50.355580+0000","last_peered":"2024-04-25T13:16:50.355580+0000","last_clean":"2024-04-25T13:16:50.355580+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:50.355580+0000","last_undegraded":"2024-04-25T13:16:50.355580+0000","last_fullsized":"2024-04-25T13:16:50.355580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.359349+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:50.359349+0000","last_peered":"2024-04-25T13:16:50.359349+0000","last_clean":"2024-04-25T13:16:50.359349+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:50.359349+0000","last_undegraded":"2024-04-25T13:16:50.359349+0000","last_fullsized":"2024-04-25T13:16:50.359349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377123+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:56.377123+0000","last_peered":"2024-04-25T13:16:56.377123+0000","last_clean":"2024-04-25T13:16:56.377123+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:56.377123+0000","last_undegraded":"2024-04-25T13:16:56.377123+0000","last_fullsized":"2024-04-25T13:16:56.377123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.370263+0000","last_change":"2024-04-25T13:16:50.370263+0000","last_active":"2024-04-25T13:16:50.370263+0000","last_peered":"2024-04-25T13:16:50.370263+0000","last_clean":"2024-04-25T13:16:50.370263+0000","last_became_active":"2024-04-25T13:16:50.369812+0000","last_became_peered":"2024-04-25T13:16:50.369812+0000","last_unstale":"2024-04-25T13:16:50.370263+0000","last_undegraded":"2024-04-25T13:16:50.370263+0000","last_fullsized":"2024-04-25T13:16:50.370263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:03.168762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356486+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:50.356486+0000","last_peered":"2024-04-25T13:16:50.356486+0000","last_clean":"2024-04-25T13:16:50.356486+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:50.356486+0000","last_undegraded":"2024-04-25T13:16:50.356486+0000","last_fullsized":"2024-04-25T13:16:50.356486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.986821+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:17:02.986821+0000","last_peered":"2024-04-25T13:17:02.986821+0000","last_clean":"2024-04-25T13:17:02.986821+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:17:02.986821+0000","last_undegraded":"2024-04-25T13:17:02.986821+0000","last_fullsized":"2024-04-25T13:17:02.986821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363856+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:50.363856+0000","last_peered":"2024-04-25T13:16:50.363856+0000","last_clean":"2024-04-25T13:16:50.363856+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:50.363856+0000","last_undegraded":"2024-04-25T13:16:50.363856+0000","last_fullsized":"2024-04-25T13:16:50.363856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355128+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:50.355128+0000","last_peered":"2024-04-25T13:16:50.355128+0000","last_clean":"2024-04-25T13:16:50.355128+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:50.355128+0000","last_undegraded":"2024-04-25T13:16:50.355128+0000","last_fullsized":"2024-04-25T13:16:50.355128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354149+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:50.354149+0000","last_peered":"2024-04-25T13:16:50.354149+0000","last_clean":"2024-04-25T13:16:50.354149+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:50.354149+0000","last_undegraded":"2024-04-25T13:16:50.354149+0000","last_fullsized":"2024-04-25T13:16:50.354149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355790+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:50.355790+0000","last_peered":"2024-04-25T13:16:50.355790+0000","last_clean":"2024-04-25T13:16:50.355790+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:50.355790+0000","last_undegraded":"2024-04-25T13:16:50.355790+0000","last_fullsized":"2024-04-25T13:16:50.355790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362945+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:50.362945+0000","last_peered":"2024-04-25T13:16:50.362945+0000","last_clean":"2024-04-25T13:16:50.362945+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:50.362945+0000","last_undegraded":"2024-04-25T13:16:50.362945+0000","last_fullsized":"2024-04-25T13:16:50.362945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:07.387828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.390990+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:17:02.390990+0000","last_peered":"2024-04-25T13:17:02.390990+0000","last_clean":"2024-04-25T13:17:02.390990+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:17:02.390990+0000","last_undegraded":"2024-04-25T13:17:02.390990+0000","last_fullsized":"2024-04-25T13:17:02.390990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354770+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:50.354770+0000","last_peered":"2024-04-25T13:16:50.354770+0000","last_clean":"2024-04-25T13:16:50.354770+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:50.354770+0000","last_undegraded":"2024-04-25T13:16:50.354770+0000","last_fullsized":"2024-04-25T13:16:50.354770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357314+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:50.357314+0000","last_peered":"2024-04-25T13:16:50.357314+0000","last_clean":"2024-04-25T13:16:50.357314+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:50.357314+0000","last_undegraded":"2024-04-25T13:16:50.357314+0000","last_fullsized":"2024-04-25T13:16:50.357314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377315+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:56.377315+0000","last_peered":"2024-04-25T13:16:56.377315+0000","last_clean":"2024-04-25T13:16:56.377315+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:56.377315+0000","last_undegraded":"2024-04-25T13:16:56.377315+0000","last_fullsized":"2024-04-25T13:16:56.377315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355824+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:50.355824+0000","last_peered":"2024-04-25T13:16:50.355824+0000","last_clean":"2024-04-25T13:16:50.355824+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:50.355824+0000","last_undegraded":"2024-04-25T13:16:50.355824+0000","last_fullsized":"2024-04-25T13:16:50.355824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364127+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:50.364127+0000","last_peered":"2024-04-25T13:16:50.364127+0000","last_clean":"2024-04-25T13:16:50.364127+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:50.364127+0000","last_undegraded":"2024-04-25T13:16:50.364127+0000","last_fullsized":"2024-04-25T13:16:50.364127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377941+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:56.377941+0000","last_peered":"2024-04-25T13:16:56.377941+0000","last_clean":"2024-04-25T13:16:56.377941+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:56.377941+0000","last_undegraded":"2024-04-25T13:16:56.377941+0000","last_fullsized":"2024-04-25T13:16:56.377941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363869+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:50.363869+0000","last_peered":"2024-04-25T13:16:50.363869+0000","last_clean":"2024-04-25T13:16:50.363869+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:50.363869+0000","last_undegraded":"2024-04-25T13:16:50.363869+0000","last_fullsized":"2024-04-25T13:16:50.363869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:52.881166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368468+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:50.368468+0000","last_peered":"2024-04-25T13:16:50.368468+0000","last_clean":"2024-04-25T13:16:50.368468+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.368468+0000","last_undegraded":"2024-04-25T13:16:50.368468+0000","last_fullsized":"2024-04-25T13:16:50.368468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364301+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:50.364301+0000","last_peered":"2024-04-25T13:16:50.364301+0000","last_clean":"2024-04-25T13:16:50.364301+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:50.364301+0000","last_undegraded":"2024-04-25T13:16:50.364301+0000","last_fullsized":"2024-04-25T13:16:50.364301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364120+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:50.364120+0000","last_peered":"2024-04-25T13:16:50.364120+0000","last_clean":"2024-04-25T13:16:50.364120+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:50.364120+0000","last_undegraded":"2024-04-25T13:16:50.364120+0000","last_fullsized":"2024-04-25T13:16:50.364120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355530+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:50.355530+0000","last_peered":"2024-04-25T13:16:50.355530+0000","last_clean":"2024-04-25T13:16:50.355530+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:50.355530+0000","last_undegraded":"2024-04-25T13:16:50.355530+0000","last_fullsized":"2024-04-25T13:16:50.355530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388455+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:17:02.388455+0000","last_peered":"2024-04-25T13:17:02.388455+0000","last_clean":"2024-04-25T13:17:02.388455+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:17:02.388455+0000","last_undegraded":"2024-04-25T13:17:02.388455+0000","last_fullsized":"2024-04-25T13:17:02.388455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363511+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:50.363511+0000","last_peered":"2024-04-25T13:16:50.363511+0000","last_clean":"2024-04-25T13:16:50.363511+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:50.363511+0000","last_undegraded":"2024-04-25T13:16:50.363511+0000","last_fullsized":"2024-04-25T13:16:50.363511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364360+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:50.364360+0000","last_peered":"2024-04-25T13:16:50.364360+0000","last_clean":"2024-04-25T13:16:50.364360+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:50.364360+0000","last_undegraded":"2024-04-25T13:16:50.364360+0000","last_fullsized":"2024-04-25T13:16:50.364360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.386945+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:17:02.386945+0000","last_peered":"2024-04-25T13:17:02.386945+0000","last_clean":"2024-04-25T13:17:02.386945+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:17:02.386945+0000","last_undegraded":"2024-04-25T13:17:02.386945+0000","last_fullsized":"2024-04-25T13:17:02.386945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364118+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:50.364118+0000","last_peered":"2024-04-25T13:16:50.364118+0000","last_clean":"2024-04-25T13:16:50.364118+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:50.364118+0000","last_undegraded":"2024-04-25T13:16:50.364118+0000","last_fullsized":"2024-04-25T13:16:50.364118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364094+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:50.364094+0000","last_peered":"2024-04-25T13:16:50.364094+0000","last_clean":"2024-04-25T13:16:50.364094+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:50.364094+0000","last_undegraded":"2024-04-25T13:16:50.364094+0000","last_fullsized":"2024-04-25T13:16:50.364094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:14.197407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365277+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:50.365277+0000","last_peered":"2024-04-25T13:16:50.365277+0000","last_clean":"2024-04-25T13:16:50.365277+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:50.365277+0000","last_undegraded":"2024-04-25T13:16:50.365277+0000","last_fullsized":"2024-04-25T13:16:50.365277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362705+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:50.362705+0000","last_peered":"2024-04-25T13:16:50.362705+0000","last_clean":"2024-04-25T13:16:50.362705+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:50.362705+0000","last_undegraded":"2024-04-25T13:16:50.362705+0000","last_fullsized":"2024-04-25T13:16:50.362705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:00.494861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.373995+0000","last_change":"2024-04-25T13:16:50.373995+0000","last_active":"2024-04-25T13:16:50.373995+0000","last_peered":"2024-04-25T13:16:50.373995+0000","last_clean":"2024-04-25T13:16:50.373995+0000","last_became_active":"2024-04-25T13:16:50.373669+0000","last_became_peered":"2024-04-25T13:16:50.373669+0000","last_unstale":"2024-04-25T13:16:50.373995+0000","last_undegraded":"2024-04-25T13:16:50.373995+0000","last_fullsized":"2024-04-25T13:16:50.373995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:28.967657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376971+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:56.376971+0000","last_peered":"2024-04-25T13:16:56.376971+0000","last_clean":"2024-04-25T13:16:56.376971+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:56.376971+0000","last_undegraded":"2024-04-25T13:16:56.376971+0000","last_fullsized":"2024-04-25T13:16:56.376971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354328+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:50.354328+0000","last_peered":"2024-04-25T13:16:50.354328+0000","last_clean":"2024-04-25T13:16:50.354328+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:50.354328+0000","last_undegraded":"2024-04-25T13:16:50.354328+0000","last_fullsized":"2024-04-25T13:16:50.354328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357049+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:50.357049+0000","last_peered":"2024-04-25T13:16:50.357049+0000","last_clean":"2024-04-25T13:16:50.357049+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:50.357049+0000","last_undegraded":"2024-04-25T13:16:50.357049+0000","last_fullsized":"2024-04-25T13:16:50.357049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365712+0000","last_change":"2024-04-25T13:16:50.365712+0000","last_active":"2024-04-25T13:16:50.365712+0000","last_peered":"2024-04-25T13:16:50.365712+0000","last_clean":"2024-04-25T13:16:50.365712+0000","last_became_active":"2024-04-25T13:16:50.365465+0000","last_became_peered":"2024-04-25T13:16:50.365465+0000","last_unstale":"2024-04-25T13:16:50.365712+0000","last_undegraded":"2024-04-25T13:16:50.365712+0000","last_fullsized":"2024-04-25T13:16:50.365712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:02.718759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.778414+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:17:10.778414+0000","last_peered":"2024-04-25T13:17:10.778414+0000","last_clean":"2024-04-25T13:17:10.778414+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:17:10.778414+0000","last_undegraded":"2024-04-25T13:17:10.778414+0000","last_fullsized":"2024-04-25T13:17:10.778414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368982+0000","last_change":"2024-04-25T13:16:50.368982+0000","last_active":"2024-04-25T13:16:50.368982+0000","last_peered":"2024-04-25T13:16:50.368982+0000","last_clean":"2024-04-25T13:16:50.368982+0000","last_became_active":"2024-04-25T13:16:50.368538+0000","last_became_peered":"2024-04-25T13:16:50.368538+0000","last_unstale":"2024-04-25T13:16:50.368982+0000","last_undegraded":"2024-04-25T13:16:50.368982+0000","last_fullsized":"2024-04-25T13:16:50.368982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:47.805583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367386+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:50.367386+0000","last_peered":"2024-04-25T13:16:50.367386+0000","last_clean":"2024-04-25T13:16:50.367386+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:50.367386+0000","last_undegraded":"2024-04-25T13:16:50.367386+0000","last_fullsized":"2024-04-25T13:16:50.367386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377057+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:56.377057+0000","last_peered":"2024-04-25T13:16:56.377057+0000","last_clean":"2024-04-25T13:16:56.377057+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:56.377057+0000","last_undegraded":"2024-04-25T13:16:56.377057+0000","last_fullsized":"2024-04-25T13:16:56.377057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364093+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:50.364093+0000","last_peered":"2024-04-25T13:16:50.364093+0000","last_clean":"2024-04-25T13:16:50.364093+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:50.364093+0000","last_undegraded":"2024-04-25T13:16:50.364093+0000","last_fullsized":"2024-04-25T13:16:50.364093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:35.815826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355622+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:50.355622+0000","last_peered":"2024-04-25T13:16:50.355622+0000","last_clean":"2024-04-25T13:16:50.355622+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:50.355622+0000","last_undegraded":"2024-04-25T13:16:50.355622+0000","last_fullsized":"2024-04-25T13:16:50.355622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.385844+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:17:02.385844+0000","last_peered":"2024-04-25T13:17:02.385844+0000","last_clean":"2024-04-25T13:17:02.385844+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:17:02.385844+0000","last_undegraded":"2024-04-25T13:17:02.385844+0000","last_fullsized":"2024-04-25T13:17:02.385844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366656+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:50.366656+0000","last_peered":"2024-04-25T13:16:50.366656+0000","last_clean":"2024-04-25T13:16:50.366656+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:50.366656+0000","last_undegraded":"2024-04-25T13:16:50.366656+0000","last_fullsized":"2024-04-25T13:16:50.366656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354864+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:50.354864+0000","last_peered":"2024-04-25T13:16:50.354864+0000","last_clean":"2024-04-25T13:16:50.354864+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:50.354864+0000","last_undegraded":"2024-04-25T13:16:50.354864+0000","last_fullsized":"2024-04-25T13:16:50.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356040+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:50.356040+0000","last_peered":"2024-04-25T13:16:50.356040+0000","last_clean":"2024-04-25T13:16:50.356040+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:50.356040+0000","last_undegraded":"2024-04-25T13:16:50.356040+0000","last_fullsized":"2024-04-25T13:16:50.356040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354663+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:50.354663+0000","last_peered":"2024-04-25T13:16:50.354663+0000","last_clean":"2024-04-25T13:16:50.354663+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:50.354663+0000","last_undegraded":"2024-04-25T13:16:50.354663+0000","last_fullsized":"2024-04-25T13:16:50.354663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354424+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:50.354424+0000","last_peered":"2024-04-25T13:16:50.354424+0000","last_clean":"2024-04-25T13:16:50.354424+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:50.354424+0000","last_undegraded":"2024-04-25T13:16:50.354424+0000","last_fullsized":"2024-04-25T13:16:50.354424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377581+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:56.377581+0000","last_peered":"2024-04-25T13:16:56.377581+0000","last_clean":"2024-04-25T13:16:56.377581+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:56.377581+0000","last_undegraded":"2024-04-25T13:16:56.377581+0000","last_fullsized":"2024-04-25T13:16:56.377581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362572+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:50.362572+0000","last_peered":"2024-04-25T13:16:50.362572+0000","last_clean":"2024-04-25T13:16:50.362572+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:50.362572+0000","last_undegraded":"2024-04-25T13:16:50.362572+0000","last_fullsized":"2024-04-25T13:16:50.362572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:15.310573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356614+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:50.356614+0000","last_peered":"2024-04-25T13:16:50.356614+0000","last_clean":"2024-04-25T13:16:50.356614+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:50.356614+0000","last_undegraded":"2024-04-25T13:16:50.356614+0000","last_fullsized":"2024-04-25T13:16:50.356614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.783746+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:17:10.783746+0000","last_peered":"2024-04-25T13:17:10.783746+0000","last_clean":"2024-04-25T13:17:10.783746+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:17:10.783746+0000","last_undegraded":"2024-04-25T13:17:10.783746+0000","last_fullsized":"2024-04-25T13:17:10.783746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357157+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:50.357157+0000","last_peered":"2024-04-25T13:16:50.357157+0000","last_clean":"2024-04-25T13:16:50.357157+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:50.357157+0000","last_undegraded":"2024-04-25T13:16:50.357157+0000","last_fullsized":"2024-04-25T13:16:50.357157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355199+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:50.355199+0000","last_peered":"2024-04-25T13:16:50.355199+0000","last_clean":"2024-04-25T13:16:50.355199+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:50.355199+0000","last_undegraded":"2024-04-25T13:16:50.355199+0000","last_fullsized":"2024-04-25T13:16:50.355199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376519+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:56.376519+0000","last_peered":"2024-04-25T13:16:56.376519+0000","last_clean":"2024-04-25T13:16:56.376519+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:56.376519+0000","last_undegraded":"2024-04-25T13:16:56.376519+0000","last_fullsized":"2024-04-25T13:16:56.376519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.358023+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:50.358023+0000","last_peered":"2024-04-25T13:16:50.358023+0000","last_clean":"2024-04-25T13:16:50.358023+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:50.358023+0000","last_undegraded":"2024-04-25T13:16:50.358023+0000","last_fullsized":"2024-04-25T13:16:50.358023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362160+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:50.362160+0000","last_peered":"2024-04-25T13:16:50.362160+0000","last_clean":"2024-04-25T13:16:50.362160+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:50.362160+0000","last_undegraded":"2024-04-25T13:16:50.362160+0000","last_fullsized":"2024-04-25T13:16:50.362160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:24.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.386036+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:17:02.386036+0000","last_peered":"2024-04-25T13:17:02.386036+0000","last_clean":"2024-04-25T13:17:02.386036+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:17:02.386036+0000","last_undegraded":"2024-04-25T13:17:02.386036+0000","last_fullsized":"2024-04-25T13:17:02.386036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:49.859293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368372+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:50.368372+0000","last_peered":"2024-04-25T13:16:50.368372+0000","last_clean":"2024-04-25T13:16:50.368372+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:50.368372+0000","last_undegraded":"2024-04-25T13:16:50.368372+0000","last_fullsized":"2024-04-25T13:16:50.368372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355360+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:50.355360+0000","last_peered":"2024-04-25T13:16:50.355360+0000","last_clean":"2024-04-25T13:16:50.355360+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:50.355360+0000","last_undegraded":"2024-04-25T13:16:50.355360+0000","last_fullsized":"2024-04-25T13:16:50.355360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.988017+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:17:10.988017+0000","last_peered":"2024-04-25T13:17:10.988017+0000","last_clean":"2024-04-25T13:17:10.988017+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:17:10.988017+0000","last_undegraded":"2024-04-25T13:17:10.988017+0000","last_fullsized":"2024-04-25T13:17:10.988017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364968+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:50.364968+0000","last_peered":"2024-04-25T13:16:50.364968+0000","last_clean":"2024-04-25T13:16:50.364968+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:50.364968+0000","last_undegraded":"2024-04-25T13:16:50.364968+0000","last_fullsized":"2024-04-25T13:16:50.364968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355772+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:50.355772+0000","last_peered":"2024-04-25T13:16:50.355772+0000","last_clean":"2024-04-25T13:16:50.355772+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:50.355772+0000","last_undegraded":"2024-04-25T13:16:50.355772+0000","last_fullsized":"2024-04-25T13:16:50.355772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364593+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:50.364593+0000","last_peered":"2024-04-25T13:16:50.364593+0000","last_clean":"2024-04-25T13:16:50.364593+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:50.364593+0000","last_undegraded":"2024-04-25T13:16:50.364593+0000","last_fullsized":"2024-04-25T13:16:50.364593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355323+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:50.355323+0000","last_peered":"2024-04-25T13:16:50.355323+0000","last_clean":"2024-04-25T13:16:50.355323+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:50.355323+0000","last_undegraded":"2024-04-25T13:16:50.355323+0000","last_fullsized":"2024-04-25T13:16:50.355323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363727+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:50.363727+0000","last_peered":"2024-04-25T13:16:50.363727+0000","last_clean":"2024-04-25T13:16:50.363727+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:50.363727+0000","last_undegraded":"2024-04-25T13:16:50.363727+0000","last_fullsized":"2024-04-25T13:16:50.363727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:59.519018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391208+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:17:02.391208+0000","last_peered":"2024-04-25T13:17:02.391208+0000","last_clean":"2024-04-25T13:17:02.391208+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:17:02.391208+0000","last_undegraded":"2024-04-25T13:17:02.391208+0000","last_fullsized":"2024-04-25T13:17:02.391208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356204+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:50.356204+0000","last_peered":"2024-04-25T13:16:50.356204+0000","last_clean":"2024-04-25T13:16:50.356204+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:50.356204+0000","last_undegraded":"2024-04-25T13:16:50.356204+0000","last_fullsized":"2024-04-25T13:16:50.356204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367495+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:50.367495+0000","last_peered":"2024-04-25T13:16:50.367495+0000","last_clean":"2024-04-25T13:16:50.367495+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:50.367495+0000","last_undegraded":"2024-04-25T13:16:50.367495+0000","last_fullsized":"2024-04-25T13:16:50.367495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781217+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:17:10.781217+0000","last_peered":"2024-04-25T13:17:10.781217+0000","last_clean":"2024-04-25T13:17:10.781217+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:17:10.781217+0000","last_undegraded":"2024-04-25T13:17:10.781217+0000","last_fullsized":"2024-04-25T13:17:10.781217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355305+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:50.355305+0000","last_peered":"2024-04-25T13:16:50.355305+0000","last_clean":"2024-04-25T13:16:50.355305+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:50.355305+0000","last_undegraded":"2024-04-25T13:16:50.355305+0000","last_fullsized":"2024-04-25T13:16:50.355305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362452+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:50.362452+0000","last_peered":"2024-04-25T13:16:50.362452+0000","last_clean":"2024-04-25T13:16:50.362452+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:50.362452+0000","last_undegraded":"2024-04-25T13:16:50.362452+0000","last_fullsized":"2024-04-25T13:16:50.362452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.475502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363321+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:50.363321+0000","last_peered":"2024-04-25T13:16:50.363321+0000","last_clean":"2024-04-25T13:16:50.363321+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:50.363321+0000","last_undegraded":"2024-04-25T13:16:50.363321+0000","last_fullsized":"2024-04-25T13:16:50.363321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376012+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:56.376012+0000","last_peered":"2024-04-25T13:16:56.376012+0000","last_clean":"2024-04-25T13:16:56.376012+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:56.376012+0000","last_undegraded":"2024-04-25T13:16:56.376012+0000","last_fullsized":"2024-04-25T13:16:56.376012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357030+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:50.357030+0000","last_peered":"2024-04-25T13:16:50.357030+0000","last_clean":"2024-04-25T13:16:50.357030+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:50.357030+0000","last_undegraded":"2024-04-25T13:16:50.357030+0000","last_fullsized":"2024-04-25T13:16:50.357030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372604+0000","last_change":"2024-04-25T13:16:50.370489+0000","last_active":"2024-04-25T13:16:50.372604+0000","last_peered":"2024-04-25T13:16:50.372604+0000","last_clean":"2024-04-25T13:16:50.372604+0000","last_became_active":"2024-04-25T13:16:50.370143+0000","last_became_peered":"2024-04-25T13:16:50.370143+0000","last_unstale":"2024-04-25T13:16:50.372604+0000","last_undegraded":"2024-04-25T13:16:50.372604+0000","last_fullsized":"2024-04-25T13:16:50.372604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:06.845107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365416+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:50.365416+0000","last_peered":"2024-04-25T13:16:50.365416+0000","last_clean":"2024-04-25T13:16:50.365416+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:50.365416+0000","last_undegraded":"2024-04-25T13:16:50.365416+0000","last_fullsized":"2024-04-25T13:16:50.365416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376785+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:56.376785+0000","last_peered":"2024-04-25T13:16:56.376785+0000","last_clean":"2024-04-25T13:16:56.376785+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:56.376785+0000","last_undegraded":"2024-04-25T13:16:56.376785+0000","last_fullsized":"2024-04-25T13:16:56.376785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364240+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:50.364240+0000","last_peered":"2024-04-25T13:16:50.364240+0000","last_clean":"2024-04-25T13:16:50.364240+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:50.364240+0000","last_undegraded":"2024-04-25T13:16:50.364240+0000","last_fullsized":"2024-04-25T13:16:50.364240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366699+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:50.366699+0000","last_peered":"2024-04-25T13:16:50.366699+0000","last_clean":"2024-04-25T13:16:50.366699+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:50.366699+0000","last_undegraded":"2024-04-25T13:16:50.366699+0000","last_fullsized":"2024-04-25T13:16:50.366699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781407+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:17:10.781407+0000","last_peered":"2024-04-25T13:17:10.781407+0000","last_clean":"2024-04-25T13:17:10.781407+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:17:10.781407+0000","last_undegraded":"2024-04-25T13:17:10.781407+0000","last_fullsized":"2024-04-25T13:17:10.781407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356066+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:50.356066+0000","last_peered":"2024-04-25T13:16:50.356066+0000","last_clean":"2024-04-25T13:16:50.356066+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:50.356066+0000","last_undegraded":"2024-04-25T13:16:50.356066+0000","last_fullsized":"2024-04-25T13:16:50.356066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357602+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:50.357602+0000","last_peered":"2024-04-25T13:16:50.357602+0000","last_clean":"2024-04-25T13:16:50.357602+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:50.357602+0000","last_undegraded":"2024-04-25T13:16:50.357602+0000","last_fullsized":"2024-04-25T13:16:50.357602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356114+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:50.356114+0000","last_peered":"2024-04-25T13:16:50.356114+0000","last_clean":"2024-04-25T13:16:50.356114+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:50.356114+0000","last_undegraded":"2024-04-25T13:16:50.356114+0000","last_fullsized":"2024-04-25T13:16:50.356114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366795+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:50.366795+0000","last_peered":"2024-04-25T13:16:50.366795+0000","last_clean":"2024-04-25T13:16:50.366795+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:50.366795+0000","last_undegraded":"2024-04-25T13:16:50.366795+0000","last_fullsized":"2024-04-25T13:16:50.366795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366978+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:50.366978+0000","last_peered":"2024-04-25T13:16:50.366978+0000","last_clean":"2024-04-25T13:16:50.366978+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:50.366978+0000","last_undegraded":"2024-04-25T13:16:50.366978+0000","last_fullsized":"2024-04-25T13:16:50.366978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364140+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:50.364140+0000","last_peered":"2024-04-25T13:16:50.364140+0000","last_clean":"2024-04-25T13:16:50.364140+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:50.364140+0000","last_undegraded":"2024-04-25T13:16:50.364140+0000","last_fullsized":"2024-04-25T13:16:50.364140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:23.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372415+0000","last_change":"2024-04-25T13:16:50.369947+0000","last_active":"2024-04-25T13:16:50.372415+0000","last_peered":"2024-04-25T13:16:50.372415+0000","last_clean":"2024-04-25T13:16:50.372415+0000","last_became_active":"2024-04-25T13:16:50.369437+0000","last_became_peered":"2024-04-25T13:16:50.369437+0000","last_unstale":"2024-04-25T13:16:50.372415+0000","last_undegraded":"2024-04-25T13:16:50.372415+0000","last_fullsized":"2024-04-25T13:16:50.372415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:26.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363154+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:50.363154+0000","last_peered":"2024-04-25T13:16:50.363154+0000","last_clean":"2024-04-25T13:16:50.363154+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:50.363154+0000","last_undegraded":"2024-04-25T13:16:50.363154+0000","last_fullsized":"2024-04-25T13:16:50.363154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357306+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:50.357306+0000","last_peered":"2024-04-25T13:16:50.357306+0000","last_clean":"2024-04-25T13:16:50.357306+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:50.357306+0000","last_undegraded":"2024-04-25T13:16:50.357306+0000","last_fullsized":"2024-04-25T13:16:50.357306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357159+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:50.357159+0000","last_peered":"2024-04-25T13:16:50.357159+0000","last_clean":"2024-04-25T13:16:50.357159+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:50.357159+0000","last_undegraded":"2024-04-25T13:16:50.357159+0000","last_fullsized":"2024-04-25T13:16:50.357159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366748+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:50.366748+0000","last_peered":"2024-04-25T13:16:50.366748+0000","last_clean":"2024-04-25T13:16:50.366748+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:50.366748+0000","last_undegraded":"2024-04-25T13:16:50.366748+0000","last_fullsized":"2024-04-25T13:16:50.366748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355469+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:50.355469+0000","last_peered":"2024-04-25T13:16:50.355469+0000","last_clean":"2024-04-25T13:16:50.355469+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:50.355469+0000","last_undegraded":"2024-04-25T13:16:50.355469+0000","last_fullsized":"2024-04-25T13:16:50.355469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366885+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:50.366885+0000","last_peered":"2024-04-25T13:16:50.366885+0000","last_clean":"2024-04-25T13:16:50.366885+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:50.366885+0000","last_undegraded":"2024-04-25T13:16:50.366885+0000","last_fullsized":"2024-04-25T13:16:50.366885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363969+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:50.363969+0000","last_peered":"2024-04-25T13:16:50.363969+0000","last_clean":"2024-04-25T13:16:50.363969+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:50.363969+0000","last_undegraded":"2024-04-25T13:16:50.363969+0000","last_fullsized":"2024-04-25T13:16:50.363969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:52.980650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357173+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:50.357173+0000","last_peered":"2024-04-25T13:16:50.357173+0000","last_clean":"2024-04-25T13:16:50.357173+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:50.357173+0000","last_undegraded":"2024-04-25T13:16:50.357173+0000","last_fullsized":"2024-04-25T13:16:50.357173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355881+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:50.355881+0000","last_peered":"2024-04-25T13:16:50.355881+0000","last_clean":"2024-04-25T13:16:50.355881+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:50.355881+0000","last_undegraded":"2024-04-25T13:16:50.355881+0000","last_fullsized":"2024-04-25T13:16:50.355881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366734+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:50.366734+0000","last_peered":"2024-04-25T13:16:50.366734+0000","last_clean":"2024-04-25T13:16:50.366734+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:50.366734+0000","last_undegraded":"2024-04-25T13:16:50.366734+0000","last_fullsized":"2024-04-25T13:16:50.366734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367697+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:50.367697+0000","last_peered":"2024-04-25T13:16:50.367697+0000","last_clean":"2024-04-25T13:16:50.367697+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:50.367697+0000","last_undegraded":"2024-04-25T13:16:50.367697+0000","last_fullsized":"2024-04-25T13:16:50.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366727+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:50.366727+0000","last_peered":"2024-04-25T13:16:50.366727+0000","last_clean":"2024-04-25T13:16:50.366727+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:50.366727+0000","last_undegraded":"2024-04-25T13:16:50.366727+0000","last_fullsized":"2024-04-25T13:16:50.366727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363431+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:50.363431+0000","last_peered":"2024-04-25T13:16:50.363431+0000","last_clean":"2024-04-25T13:16:50.363431+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:50.363431+0000","last_undegraded":"2024-04-25T13:16:50.363431+0000","last_fullsized":"2024-04-25T13:16:50.363431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362040+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:50.362040+0000","last_peered":"2024-04-25T13:16:50.362040+0000","last_clean":"2024-04-25T13:16:50.362040+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:50.362040+0000","last_undegraded":"2024-04-25T13:16:50.362040+0000","last_fullsized":"2024-04-25T13:16:50.362040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:44.821443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356705+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:50.356705+0000","last_peered":"2024-04-25T13:16:50.356705+0000","last_clean":"2024-04-25T13:16:50.356705+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:50.356705+0000","last_undegraded":"2024-04-25T13:16:50.356705+0000","last_fullsized":"2024-04-25T13:16:50.356705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355690+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:50.355690+0000","last_peered":"2024-04-25T13:16:50.355690+0000","last_clean":"2024-04-25T13:16:50.355690+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:50.355690+0000","last_undegraded":"2024-04-25T13:16:50.355690+0000","last_fullsized":"2024-04-25T13:16:50.355690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357158+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:50.357158+0000","last_peered":"2024-04-25T13:16:50.357158+0000","last_clean":"2024-04-25T13:16:50.357158+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.357158+0000","last_undegraded":"2024-04-25T13:16:50.357158+0000","last_fullsized":"2024-04-25T13:16:50.357158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357282+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:50.357282+0000","last_peered":"2024-04-25T13:16:50.357282+0000","last_clean":"2024-04-25T13:16:50.357282+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:50.357282+0000","last_undegraded":"2024-04-25T13:16:50.357282+0000","last_fullsized":"2024-04-25T13:16:50.357282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365616+0000","last_change":"2024-04-25T13:16:50.365616+0000","last_active":"2024-04-25T13:16:50.365616+0000","last_peered":"2024-04-25T13:16:50.365616+0000","last_clean":"2024-04-25T13:16:50.365616+0000","last_became_active":"2024-04-25T13:16:50.365415+0000","last_became_peered":"2024-04-25T13:16:50.365415+0000","last_unstale":"2024-04-25T13:16:50.365616+0000","last_undegraded":"2024-04-25T13:16:50.365616+0000","last_fullsized":"2024-04-25T13:16:50.365616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:37.667075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356014+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:50.356014+0000","last_peered":"2024-04-25T13:16:50.356014+0000","last_clean":"2024-04-25T13:16:50.356014+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:50.356014+0000","last_undegraded":"2024-04-25T13:16:50.356014+0000","last_fullsized":"2024-04-25T13:16:50.356014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372305+0000","last_change":"2024-04-25T13:16:50.370418+0000","last_active":"2024-04-25T13:16:50.372305+0000","last_peered":"2024-04-25T13:16:50.372305+0000","last_clean":"2024-04-25T13:16:50.372305+0000","last_became_active":"2024-04-25T13:16:50.370066+0000","last_became_peered":"2024-04-25T13:16:50.370066+0000","last_unstale":"2024-04-25T13:16:50.372305+0000","last_undegraded":"2024-04-25T13:16:50.372305+0000","last_fullsized":"2024-04-25T13:16:50.372305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:17.756850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366860+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:50.366860+0000","last_peered":"2024-04-25T13:16:50.366860+0000","last_clean":"2024-04-25T13:16:50.366860+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:50.366860+0000","last_undegraded":"2024-04-25T13:16:50.366860+0000","last_fullsized":"2024-04-25T13:16:50.366860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355061+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:50.355061+0000","last_peered":"2024-04-25T13:16:50.355061+0000","last_clean":"2024-04-25T13:16:50.355061+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:50.355061+0000","last_undegraded":"2024-04-25T13:16:50.355061+0000","last_fullsized":"2024-04-25T13:16:50.355061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367300+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:50.367300+0000","last_peered":"2024-04-25T13:16:50.367300+0000","last_clean":"2024-04-25T13:16:50.367300+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:50.367300+0000","last_undegraded":"2024-04-25T13:16:50.367300+0000","last_fullsized":"2024-04-25T13:16:50.367300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363217+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:50.363217+0000","last_peered":"2024-04-25T13:16:50.363217+0000","last_clean":"2024-04-25T13:16:50.363217+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:50.363217+0000","last_undegraded":"2024-04-25T13:16:50.363217+0000","last_fullsized":"2024-04-25T13:16:50.363217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:51.820664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362907+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:50.362907+0000","last_peered":"2024-04-25T13:16:50.362907+0000","last_clean":"2024-04-25T13:16:50.362907+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:50.362907+0000","last_undegraded":"2024-04-25T13:16:50.362907+0000","last_fullsized":"2024-04-25T13:16:50.362907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355523+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:50.355523+0000","last_peered":"2024-04-25T13:16:50.355523+0000","last_clean":"2024-04-25T13:16:50.355523+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:50.355523+0000","last_undegraded":"2024-04-25T13:16:50.355523+0000","last_fullsized":"2024-04-25T13:16:50.355523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":120093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:24.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:24.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.324+0000 7f8a8dfef640 1 Processor -- start 2024-04-25T13:17:24.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.324+0000 7f8a8dfef640 1 -- start start 2024-04-25T13:17:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.325+0000 7f8a8dfef640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a880d08a0 0x7f8a880d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.325+0000 7f8a8dfef640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a881558c0 con 0x7f8a881554e0 2024-04-25T13:17:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.325+0000 7f8a8dfef640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880cb8c0 con 0x7f8a880b3c00 2024-04-25T13:17:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.325+0000 7f8a8dfef640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8a880b4a80 con 0x7f8a880d08a0 2024-04-25T13:17:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.325+0000 7f8a87fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a880d08a0 0x7f8a880d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.325+0000 7f8a877fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8a881554e0 0x7f8a8815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36812/0 (socket says 172.21.15.26:36812) 2024-04-25T13:17:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.325+0000 7f8a877fe640 1 -- 172.21.15.26:0/708417854 learned_addr learned my addr 172.21.15.26:0/708417854 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.326+0000 7f8a87fff640 1 -- 172.21.15.26:0/708417854 >> v1:172.21.15.169:6789/0 conn(0x7f8a880b3c00 legacy=0x7f8a880b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.326+0000 7f8a87fff640 1 -- 172.21.15.26:0/708417854 >> v1:172.21.15.26:6789/0 conn(0x7f8a881554e0 legacy=0x7f8a8815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.326+0000 7f8a87fff640 1 -- 172.21.15.26:0/708417854 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880cbba0 con 0x7f8a880d08a0 2024-04-25T13:17:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.326+0000 7f8a87fff640 1 --2- 172.21.15.26:0/708417854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880d08a0 0x7f8a880d0cd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009d90 tx=0x7f8a8002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fa9c60f67838e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:24.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.326+0000 7f8a867fc640 1 -- 172.21.15.26:0/708417854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80007740 con 0x7f8a880d08a0 2024-04-25T13:17:24.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.326+0000 7f8a867fc640 1 -- 172.21.15.26:0/708417854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a800078e0 con 0x7f8a880d08a0 2024-04-25T13:17:24.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.326+0000 7f8a867fc640 1 -- 172.21.15.26:0/708417854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80007cb0 con 0x7f8a880d08a0 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.327+0000 7f8a8dfef640 1 -- 172.21.15.26:0/708417854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880d08a0 msgr2=0x7f8a880d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.327+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/708417854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880d08a0 0x7f8a880d0cd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009d90 tx=0x7f8a8002a680 comp rx=0 tx=0).stop 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.327+0000 7f8a8dfef640 1 -- 172.21.15.26:0/708417854 shutdown_connections 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.327+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/708417854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880d08a0 0x7f8a880d0cd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.327+0000 7f8a8dfef640 1 -- 172.21.15.26:0/708417854 >> 172.21.15.26:0/708417854 conn(0x7f8a88074d50 msgr2=0x7f8a88075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.327+0000 7f8a8dfef640 1 -- 172.21.15.26:0/708417854 shutdown_connections 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.327+0000 7f8a8dfef640 1 -- 172.21.15.26:0/708417854 wait complete. 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.328+0000 7f8a8dfef640 1 Processor -- start 2024-04-25T13:17:24.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.328+0000 7f8a8dfef640 1 -- start start 2024-04-25T13:17:24.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a8dfef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a880b3c00 0x7f8a880c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:24.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a8dfef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880d08a0 0x7f8a880ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:24.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a8dfef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a881554e0 0x7f8a88150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:24.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a8dfef640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b4710 con 0x7f8a881554e0 2024-04-25T13:17:24.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a8dfef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b4430 con 0x7f8a880d08a0 2024-04-25T13:17:24.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a8dfef640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880b3580 con 0x7f8a880b3c00 2024-04-25T13:17:24.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a87fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a881554e0 0x7f8a88150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:24.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a87fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a881554e0 0x7f8a88150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60286/0 (socket says 172.21.15.26:60286) 2024-04-25T13:17:24.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a87fff640 1 -- 172.21.15.26:0/42812481 learned_addr learned my addr 172.21.15.26:0/42812481 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:24.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a877fe640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a880b3c00 0x7f8a880c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:24.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.329+0000 7f8a86ffd640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880d08a0 0x7f8a880ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:24.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a87fff640 1 -- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a880b3c00 msgr2=0x7f8a880c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a87fff640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a880b3c00 0x7f8a880c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a87fff640 1 -- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880d08a0 msgr2=0x7f8a880ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a87fff640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880d08a0 0x7f8a880ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a87fff640 1 -- 172.21.15.26:0/42812481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880c8f80 con 0x7f8a881554e0 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a87fff640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a881554e0 0x7f8a88150740 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009eb0 tx=0x7f8a80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a6ffff640 1 -- 172.21.15.26:0/42812481 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80041070 con 0x7f8a881554e0 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a6ffff640 1 -- 172.21.15.26:0/42812481 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80031c40 con 0x7f8a881554e0 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8814f980 con 0x7f8a881554e0 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a6ffff640 1 -- 172.21.15.26:0/42812481 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80003990 con 0x7f8a881554e0 2024-04-25T13:17:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.330+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8814ff40 con 0x7f8a881554e0 2024-04-25T13:17:24.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.331+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a88068e40 con 0x7f8a881554e0 2024-04-25T13:17:24.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.331+0000 7f8a6ffff640 1 -- 172.21.15.26:0/42812481 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a80039040 con 0x7f8a881554e0 2024-04-25T13:17:24.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.332+0000 7f8a6ffff640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a7406c920 0x7f8a7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:24.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.332+0000 7f8a6ffff640 1 -- 172.21.15.26:0/42812481 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f8a800ad270 con 0x7f8a881554e0 2024-04-25T13:17:24.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.332+0000 7f8a877fe640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a7406c920 0x7f8a7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:24.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.333+0000 7f8a877fe640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a7406c920 0x7f8a7406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a78000f60 tx=0x7f8a78007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:24.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.336+0000 7f8a6ffff640 1 -- 172.21.15.26:0/42812481 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a8007b1d0 con 0x7f8a881554e0 2024-04-25T13:17:24.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.523+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a880cd3e0 con 0x7f8a881554e0 2024-04-25T13:17:24.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.524+0000 7f8a6ffff640 1 -- 172.21.15.26:0/42812481 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18947 (secure 0 0 0) 0x7f8a8007aad0 con 0x7f8a881554e0 2024-04-25T13:17:24.524 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:24.524 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:50.350764+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:24.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a7406c920 msgr2=0x7f8a7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a7406c920 0x7f8a7406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a78000f60 tx=0x7f8a78007c60 comp rx=0 tx=0).stop 2024-04-25T13:17:24.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a881554e0 msgr2=0x7f8a88150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:24.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a881554e0 0x7f8a88150740 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009eb0 tx=0x7f8a80004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 shutdown_connections 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a7406c920 0x7f8a7406ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a881554e0 0x7f8a88150740 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880d08a0 0x7f8a880ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 --2- 172.21.15.26:0/42812481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a880b3c00 0x7f8a880c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 >> 172.21.15.26:0/42812481 conn(0x7f8a88074d50 msgr2=0x7f8a880cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 shutdown_connections 2024-04-25T13:17:24.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:24.526+0000 7f8a8dfef640 1 -- 172.21.15.26:0/42812481 wait complete. 2024-04-25T13:17:25.538 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T13:17:25.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:25.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.656+0000 7fd4ba58a640 1 Processor -- start 2024-04-25T13:17:25.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.656+0000 7fd4ba58a640 1 -- start start 2024-04-25T13:17:25.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.657+0000 7fd4ba58a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4b415e8d0 0x7fd4b415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.657+0000 7fd4ba58a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4b4071af0 con 0x7fd4b40723a0 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.657+0000 7fd4ba58a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4b40c9000 con 0x7fd4b415e4f0 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.657+0000 7fd4ba58a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b40c92e0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.657+0000 7fd4b8b27640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4b415e8d0 0x7fd4b415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.657+0000 7fd4b37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd4b40723a0 0x7fd4b4072810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36826/0 (socket says 172.21.15.26:36826) 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.657+0000 7fd4b37fe640 1 -- 172.21.15.26:0/2121398173 learned_addr learned my addr 172.21.15.26:0/2121398173 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b8b27640 1 -- 172.21.15.26:0/2121398173 >> v1:172.21.15.169:6789/0 conn(0x7fd4b415e4f0 legacy=0x7fd4b406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:25.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b8b27640 1 -- 172.21.15.26:0/2121398173 >> v1:172.21.15.26:6789/0 conn(0x7fd4b40723a0 legacy=0x7fd4b4072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b2ffd640 1 -- 172.21.15.26:0/2121398173 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254338157 0 0) 0x7fd4b4071af0 con 0x7fd4b40723a0 2024-04-25T13:17:25.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b8b27640 1 -- 172.21.15.26:0/2121398173 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b40c95c0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b8b27640 1 --2- 172.21.15.26:0/2121398173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b415ed20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009d90 tx=0x7fd4ac02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565645589a6db43d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:25.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b2ffd640 1 -- 172.21.15.26:0/2121398173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac007740 con 0x7fd4b415e8d0 2024-04-25T13:17:25.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b2ffd640 1 -- 172.21.15.26:0/2121398173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ac0078e0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.658+0000 7fd4b2ffd640 1 -- 172.21.15.26:0/2121398173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac007cb0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.659+0000 7fd4ba58a640 1 -- 172.21.15.26:0/2121398173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 msgr2=0x7fd4b415ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.659+0000 7fd4ba58a640 1 --2- 172.21.15.26:0/2121398173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b415ed20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009d90 tx=0x7fd4ac02a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.659+0000 7fd4ba58a640 1 -- 172.21.15.26:0/2121398173 shutdown_connections 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.659+0000 7fd4ba58a640 1 --2- 172.21.15.26:0/2121398173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b415ed20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.659+0000 7fd4ba58a640 1 -- 172.21.15.26:0/2121398173 >> 172.21.15.26:0/2121398173 conn(0x7fd4b406f1e0 msgr2=0x7fd4b406f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.659+0000 7fd4ba58a640 1 -- 172.21.15.26:0/2121398173 shutdown_connections 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.659+0000 7fd4ba58a640 1 -- 172.21.15.26:0/2121398173 wait complete. 2024-04-25T13:17:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.660+0000 7fd4ba58a640 1 Processor -- start 2024-04-25T13:17:25.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.660+0000 7fd4ba58a640 1 -- start start 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4ba58a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b40723a0 0x7fd4b41f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4ba58a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b415e4f0 0x7fd4b414a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4ba58a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4ba58a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b415f260 con 0x7fd4b415e8d0 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4ba58a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40c9b80 con 0x7fd4b415e4f0 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4ba58a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b415f3e0 con 0x7fd4b40723a0 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4b8b27640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4b8b27640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b414ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60308/0 (socket says 172.21.15.26:60308) 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.661+0000 7fd4b8b27640 1 -- 172.21.15.26:0/3081951125 learned_addr learned my addr 172.21.15.26:0/3081951125 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b37fe640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b415e4f0 0x7fd4b414a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b3fff640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b40723a0 0x7fd4b41f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b8b27640 1 -- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b40723a0 msgr2=0x7fd4b41f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b8b27640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b40723a0 0x7fd4b41f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b8b27640 1 -- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b415e4f0 msgr2=0x7fd4b414a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b8b27640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b415e4f0 0x7fd4b414a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b8b27640 1 -- 172.21.15.26:0/3081951125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b40ca880 con 0x7fd4b415e8d0 2024-04-25T13:17:25.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b8b27640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b414ace0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009e80 tx=0x7fd4ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac03f070 con 0x7fd4b415e8d0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ac031cb0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b4148620 con 0x7fd4b415e8d0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac031e60 con 0x7fd4b415e8d0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.662+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b4148bc0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.663+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4b4068f50 con 0x7fd4b415e8d0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.664+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4ac03b410 con 0x7fd4b415e8d0 2024-04-25T13:17:25.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.664+0000 7fd4b0ff9640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd49406c8f0 0x7fd49406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.664+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fd4ac0ad8a0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.664+0000 7fd4b0ff9640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fd494076400 0x7fd4940788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.664+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 --> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd494078f70 con 0x7fd494076400 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.664+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd4ac0b22c0 con 0x7fd4b415e8d0 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.664+0000 7fd4b3fff640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd49406c8f0 0x7fd49406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.665+0000 7fd4b37fe640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fd494076400 0x7fd4940788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.665+0000 7fd4b37fe640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fd494076400 0x7fd4940788a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:25.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.665+0000 7fd4b3fff640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd49406c8f0 0x7fd49406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd49c000f60 tx=0x7fd49c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:25.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.666+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== osd.0 v2:172.21.15.26:6816/2347346544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd494078f70 con 0x7fd494076400 2024-04-25T13:17:25.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 --> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd4b4158840 con 0x7fd494076400 2024-04-25T13:17:25.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4b0ff9640 1 -- 172.21.15.26:0/3081951125 <== osd.0 v2:172.21.15.26:6816/2347346544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd4b4158840 con 0x7fd494076400 2024-04-25T13:17:25.680 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:25.680 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:25.680 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fd494076400 msgr2=0x7fd4940788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4ba58a640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:6816/2347346544,v1:172.21.15.26:6817/2347346544] conn(0x7fd494076400 0x7fd4940788a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd49406c8f0 msgr2=0x7fd49406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4ba58a640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd49406c8f0 0x7fd49406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd49c000f60 tx=0x7fd49c009040 comp rx=0 tx=0).stop 2024-04-25T13:17:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 msgr2=0x7fd4b414ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4ba58a640 1 --2- 172.21.15.26:0/3081951125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b415e8d0 0x7fd4b414ace0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009e80 tx=0x7fd4ac004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.679+0000 7fd4b8b27640 1 -- 172.21.15.26:0/3081951125 reap_dead start 2024-04-25T13:17:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.680+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 shutdown_connections 2024-04-25T13:17:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.680+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 >> 172.21.15.26:0/3081951125 conn(0x7fd4b406f1e0 msgr2=0x7fd4b40c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.680+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 shutdown_connections 2024-04-25T13:17:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.680+0000 7fd4ba58a640 1 -- 172.21.15.26:0/3081951125 wait complete. 2024-04-25T13:17:25.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T13:17:25.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.793+0000 7fdf81f51640 1 Processor -- start 2024-04-25T13:17:25.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.793+0000 7fdf81f51640 1 -- start start 2024-04-25T13:17:25.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf81f51640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdf7c0b3c00 0x7fdf7c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf81f51640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf7c0b5450 0x7fdf7c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf81f51640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf7c1558c0 con 0x7fdf7c1554e0 2024-04-25T13:17:25.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf81f51640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c0b4a80 con 0x7fdf7c0b5450 2024-04-25T13:17:25.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf81f51640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c0cb8c0 con 0x7fdf7c0b3c00 2024-04-25T13:17:25.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf7c0b5450 0x7fdf7c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf7c0b5450 0x7fdf7c0d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60324/0 (socket says 172.21.15.26:60324) 2024-04-25T13:17:25.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7bfff640 1 -- 172.21.15.26:0/2400509252 learned_addr learned my addr 172.21.15.26:0/2400509252 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:25.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7affd640 1 --2- 172.21.15.26:0/2400509252 >> v2:172.21.15.169:3300/0 conn(0x7fdf7c0b3c00 0x7fdf7c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7bfff640 1 -- 172.21.15.26:0/2400509252 >> v2:172.21.15.169:3300/0 conn(0x7fdf7c0b3c00 msgr2=0x7fdf7c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:25.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7bfff640 1 --2- 172.21.15.26:0/2400509252 >> v2:172.21.15.169:3300/0 conn(0x7fdf7c0b3c00 0x7fdf7c0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7bfff640 1 -- 172.21.15.26:0/2400509252 >> v1:172.21.15.169:6789/0 conn(0x7fdf7c1554e0 legacy=0x7fdf7c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.794+0000 7fdf7bfff640 1 -- 172.21.15.26:0/2400509252 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c0cbba0 con 0x7fdf7c0b5450 2024-04-25T13:17:25.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.795+0000 7fdf7bfff640 1 --2- 172.21.15.26:0/2400509252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c0d08a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0b6040 tx=0x7fdf7402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32af256146c269f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:25.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.795+0000 7fdf7a7fc640 1 -- 172.21.15.26:0/2400509252 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf74036070 con 0x7fdf7c0b5450 2024-04-25T13:17:25.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.795+0000 7fdf7a7fc640 1 -- 172.21.15.26:0/2400509252 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf74031600 con 0x7fdf7c0b5450 2024-04-25T13:17:25.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.795+0000 7fdf7a7fc640 1 -- 172.21.15.26:0/2400509252 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf740319f0 con 0x7fdf7c0b5450 2024-04-25T13:17:25.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 -- 172.21.15.26:0/2400509252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 msgr2=0x7fdf7c0d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 --2- 172.21.15.26:0/2400509252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c0d08a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0b6040 tx=0x7fdf7402a7c0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 -- 172.21.15.26:0/2400509252 shutdown_connections 2024-04-25T13:17:25.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 --2- 172.21.15.26:0/2400509252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c0d08a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 --2- 172.21.15.26:0/2400509252 >> v2:172.21.15.169:3300/0 conn(0x7fdf7c0b3c00 0x7fdf7c0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 -- 172.21.15.26:0/2400509252 >> 172.21.15.26:0/2400509252 conn(0x7fdf7c074d50 msgr2=0x7fdf7c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:25.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 -- 172.21.15.26:0/2400509252 shutdown_connections 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.796+0000 7fdf81f51640 1 -- 172.21.15.26:0/2400509252 wait complete. 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.797+0000 7fdf81f51640 1 Processor -- start 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.797+0000 7fdf81f51640 1 -- start start 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf81f51640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf7c0b3c00 0x7fdf7c149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf81f51640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf81f51640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7c1554e0 0x7fdf7c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf81f51640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c0b4710 con 0x7fdf7c0b5450 2024-04-25T13:17:25.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf81f51640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c0b4430 con 0x7fdf7c0b3c00 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf81f51640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c0b3580 con 0x7fdf7c1554e0 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c14ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60336/0 (socket says 172.21.15.26:60336) 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 -- 172.21.15.26:0/1122709278 learned_addr learned my addr 172.21.15.26:0/1122709278 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 -- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7c1554e0 msgr2=0x7fdf7c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7bfff640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7c1554e0 0x7fdf7c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7c1554e0 0x7fdf7c0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 -- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf7c0b3c00 msgr2=0x7fdf7c149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7b7fe640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf7c0b3c00 0x7fdf7c149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf7c0b3c00 0x7fdf7c149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7affd640 1 -- 172.21.15.26:0/1122709278 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c0ca220 con 0x7fdf7c0b5450 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.798+0000 7fdf7b7fe640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf7c0b3c00 0x7fdf7c149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.799+0000 7fdf7affd640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c14ad90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000e870 tx=0x7fdf7000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.799+0000 7fdf63fff640 1 -- 172.21.15.26:0/1122709278 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70017070 con 0x7fdf7c0b5450 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.799+0000 7fdf63fff640 1 -- 172.21.15.26:0/1122709278 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7000c940 con 0x7fdf7c0b5450 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.799+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7c0ca4c0 con 0x7fdf7c0b5450 2024-04-25T13:17:25.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.799+0000 7fdf63fff640 1 -- 172.21.15.26:0/1122709278 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000cd30 con 0x7fdf7c0b5450 2024-04-25T13:17:25.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.799+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7c0caa80 con 0x7fdf7c0b5450 2024-04-25T13:17:25.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.800+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7c068e40 con 0x7fdf7c0b5450 2024-04-25T13:17:25.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.800+0000 7fdf63fff640 1 -- 172.21.15.26:0/1122709278 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf7001a070 con 0x7fdf7c0b5450 2024-04-25T13:17:25.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.801+0000 7fdf63fff640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdf6806c8f0 0x7fdf6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:25.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.801+0000 7fdf63fff640 1 -- 172.21.15.26:0/1122709278 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fdf7008be60 con 0x7fdf7c0b5450 2024-04-25T13:17:25.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.801+0000 7fdf7b7fe640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdf6806c8f0 0x7fdf6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:25.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.802+0000 7fdf7b7fe640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdf6806c8f0 0x7fdf6806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c001680 tx=0x7fdf6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:25.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.805+0000 7fdf63fff640 1 -- 172.21.15.26:0/1122709278 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf70059e50 con 0x7fdf7c0b5450 2024-04-25T13:17:25.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.989+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdf7c0c7010 con 0x7fdf6806c8f0 2024-04-25T13:17:25.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.990+0000 7fdf63fff640 1 -- 172.21.15.26:0/1122709278 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdf7c0c7010 con 0x7fdf6806c8f0 2024-04-25T13:17:25.990 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T13:17:25.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdf6806c8f0 msgr2=0x7fdf6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdf6806c8f0 0x7fdf6806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c001680 tx=0x7fdf6c009040 comp rx=0 tx=0).stop 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 msgr2=0x7fdf7c14ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c14ad90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000e870 tx=0x7fdf7000ed30 comp rx=0 tx=0).stop 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 shutdown_connections 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fdf6806c8f0 0x7fdf6806edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7c1554e0 0x7fdf7c0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0b5450 0x7fdf7c14ad90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 --2- 172.21.15.26:0/1122709278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf7c0b3c00 0x7fdf7c149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 >> 172.21.15.26:0/1122709278 conn(0x7fdf7c074d50 msgr2=0x7fdf7c154740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:25.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 shutdown_connections 2024-04-25T13:17:25.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:25.992+0000 7fdf81f51640 1 -- 172.21.15.26:0/1122709278 wait complete. 2024-04-25T13:17:26.003 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T13:17:26.003 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:26.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.108+0000 7fd914431640 1 Processor -- start 2024-04-25T13:17:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.108+0000 7fd914431640 1 -- start start 2024-04-25T13:17:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd914431640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c0cb750 0x7fd90c071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd914431640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd90c071a50 0x7fd90c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd914431640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90c15c0f0 con 0x7fd90c15bc80 2024-04-25T13:17:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd914431640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c15ea80 con 0x7fd90c071a50 2024-04-25T13:17:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd914431640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c15ed60 con 0x7fd90c0cb750 2024-04-25T13:17:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd9121cd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c0cb750 0x7fd90c071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd9119cc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd90c071a50 0x7fd90c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd9129ce640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd90c15bc80 0x7fd90c06b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:48346/0 (socket says 172.21.15.26:48346) 2024-04-25T13:17:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.109+0000 7fd9129ce640 1 -- 172.21.15.26:0/4109551190 learned_addr learned my addr 172.21.15.26:0/4109551190 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.110+0000 7fd9111cb640 1 -- 172.21.15.26:0/4109551190 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746442470 0 0) 0x7fd90c15c0f0 con 0x7fd90c15bc80 2024-04-25T13:17:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.110+0000 7fd9121cd640 1 -- 172.21.15.26:0/4109551190 >> v2:172.21.15.169:3300/0 conn(0x7fd90c071a50 msgr2=0x7fd90c15b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.110+0000 7fd9121cd640 1 --2- 172.21.15.26:0/4109551190 >> v2:172.21.15.169:3300/0 conn(0x7fd90c071a50 0x7fd90c15b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.110+0000 7fd9121cd640 1 -- 172.21.15.26:0/4109551190 >> v1:172.21.15.169:6789/0 conn(0x7fd90c15bc80 legacy=0x7fd90c06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.110+0000 7fd9121cd640 1 -- 172.21.15.26:0/4109551190 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c15f040 con 0x7fd90c0cb750 2024-04-25T13:17:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.110+0000 7fd9121cd640 1 --2- 172.21.15.26:0/4109551190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c0cb750 0x7fd90c071510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd9040097a0 tx=0x7fd90402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ee657960d9fbe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd9111cb640 1 -- 172.21.15.26:0/4109551190 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904037070 con 0x7fd90c0cb750 2024-04-25T13:17:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd9111cb640 1 -- 172.21.15.26:0/4109551190 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd904032440 con 0x7fd90c0cb750 2024-04-25T13:17:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd9111cb640 1 -- 172.21.15.26:0/4109551190 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904032810 con 0x7fd90c0cb750 2024-04-25T13:17:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 -- 172.21.15.26:0/4109551190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c0cb750 msgr2=0x7fd90c071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 --2- 172.21.15.26:0/4109551190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c0cb750 0x7fd90c071510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd9040097a0 tx=0x7fd90402a210 comp rx=0 tx=0).stop 2024-04-25T13:17:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 -- 172.21.15.26:0/4109551190 shutdown_connections 2024-04-25T13:17:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 --2- 172.21.15.26:0/4109551190 >> v2:172.21.15.169:3300/0 conn(0x7fd90c071a50 0x7fd90c15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 --2- 172.21.15.26:0/4109551190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c0cb750 0x7fd90c071510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 -- 172.21.15.26:0/4109551190 >> 172.21.15.26:0/4109551190 conn(0x7fd90c074d50 msgr2=0x7fd90c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 -- 172.21.15.26:0/4109551190 shutdown_connections 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.111+0000 7fd914431640 1 -- 172.21.15.26:0/4109551190 wait complete. 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.112+0000 7fd914431640 1 Processor -- start 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.112+0000 7fd914431640 1 -- start start 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd914431640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c071a50 0x7fd90c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd914431640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c0cb750 0x7fd90c156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd914431640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd90c15bc80 0x7fd90c1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd914431640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c06c030 con 0x7fd90c0cb750 2024-04-25T13:17:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd914431640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c15f600 con 0x7fd90c15bc80 2024-04-25T13:17:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd914431640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c06c1b0 con 0x7fd90c071a50 2024-04-25T13:17:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd9119cc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c0cb750 0x7fd90c156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd9119cc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c0cb750 0x7fd90c156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60350/0 (socket says 172.21.15.26:60350) 2024-04-25T13:17:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd9119cc640 1 -- 172.21.15.26:0/3715396349 learned_addr learned my addr 172.21.15.26:0/3715396349 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd9121cd640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c071a50 0x7fd90c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.113+0000 7fd9129ce640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd90c15bc80 0x7fd90c1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd9119cc640 1 -- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c071a50 msgr2=0x7fd90c1558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd9119cc640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd90c071a50 0x7fd90c1558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd9119cc640 1 -- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd90c15bc80 msgr2=0x7fd90c1f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd9119cc640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd90c15bc80 0x7fd90c1f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd9119cc640 1 -- 172.21.15.26:0/3715396349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c1f4b60 con 0x7fd90c0cb750 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd9129ce640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd90c15bc80 0x7fd90c1f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd9119cc640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c0cb750 0x7fd90c156860 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd90000e9e0 tx=0x7fd90000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900017070 con 0x7fd90c0cb750 2024-04-25T13:17:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90000c9d0 con 0x7fd90c0cb750 2024-04-25T13:17:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c156da0 con 0x7fd90c0cb750 2024-04-25T13:17:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90000cdc0 con 0x7fd90c0cb750 2024-04-25T13:17:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.114+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c1f4df0 con 0x7fd90c0cb750 2024-04-25T13:17:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.115+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd90c15e7a0 con 0x7fd90c0cb750 2024-04-25T13:17:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd90001a070 con 0x7fd90c0cb750 2024-04-25T13:17:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd90affd640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd8f806c8f0 0x7fd8f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fd90008c320 con 0x7fd90c0cb750 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd90affd640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7fd8f8076410 0x7fd8f80788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 --> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd900026e50 con 0x7fd8f8076410 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd90008c7b0 con 0x7fd90c0cb750 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd9121cd640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd8f806c8f0 0x7fd8f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.116+0000 7fd9129ce640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7fd8f8076410 0x7fd8f80788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.117+0000 7fd9129ce640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7fd8f8076410 0x7fd8f80788b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.117+0000 7fd9121cd640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd8f806c8f0 0x7fd8f806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd904034000 tx=0x7fd90402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.117+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== osd.1 v2:172.21.15.26:6800/1755672510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd900026e50 con 0x7fd8f8076410 2024-04-25T13:17:26.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.130+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 --> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd90c068f50 con 0x7fd8f8076410 2024-04-25T13:17:26.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd90affd640 1 -- 172.21.15.26:0/3715396349 <== osd.1 v2:172.21.15.26:6800/1755672510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd90c068f50 con 0x7fd8f8076410 2024-04-25T13:17:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:26.131 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:26.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7fd8f8076410 msgr2=0x7fd8f80788b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:6800/1755672510,v1:172.21.15.26:6801/1755672510] conn(0x7fd8f8076410 0x7fd8f80788b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd8f806c8f0 msgr2=0x7fd8f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd8f806c8f0 0x7fd8f806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd904034000 tx=0x7fd90402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c0cb750 msgr2=0x7fd90c156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 --2- 172.21.15.26:0/3715396349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c0cb750 0x7fd90c156860 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd90000e9e0 tx=0x7fd90000eea0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd9129ce640 1 -- 172.21.15.26:0/3715396349 reap_dead start 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 shutdown_connections 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 >> 172.21.15.26:0/3715396349 conn(0x7fd90c074d50 msgr2=0x7fd90c15caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 shutdown_connections 2024-04-25T13:17:26.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.131+0000 7fd914431640 1 -- 172.21.15.26:0/3715396349 wait complete. 2024-04-25T13:17:26.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T13:17:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.243+0000 7f65248a7640 1 Processor -- start 2024-04-25T13:17:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f65248a7640 1 -- start start 2024-04-25T13:17:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f65248a7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65201554e0 0x7f652015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f65248a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b3c00 0x7f65200b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f65248a7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f65200b5450 0x7f65200d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f65248a7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f65200b4a80 con 0x7f65201554e0 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f65248a7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f65201558c0 con 0x7f65200b5450 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f65248a7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f652015f630 con 0x7f65200b3c00 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f651e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65201554e0 0x7f652015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f651e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65201554e0 0x7f652015f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60356/0 (socket says 172.21.15.26:60356) 2024-04-25T13:17:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.244+0000 7f651e59c640 1 -- 172.21.15.26:0/1157748037 learned_addr learned my addr 172.21.15.26:0/1157748037 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f6517fff640 1 --2- 172.21.15.26:0/1157748037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b3c00 0x7f65200b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f651ed9d640 1 --2- 172.21.15.26:0/1157748037 >> v2:172.21.15.169:3300/0 conn(0x7f65200b5450 0x7f65200d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f651e59c640 1 -- 172.21.15.26:0/1157748037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b3c00 msgr2=0x7f65200b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f651e59c640 1 --2- 172.21.15.26:0/1157748037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b3c00 0x7f65200b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f651e59c640 1 -- 172.21.15.26:0/1157748037 >> v2:172.21.15.169:3300/0 conn(0x7f65200b5450 msgr2=0x7f65200d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f651e59c640 1 --2- 172.21.15.26:0/1157748037 >> v2:172.21.15.169:3300/0 conn(0x7f65200b5450 0x7f65200d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f651e59c640 1 -- 172.21.15.26:0/1157748037 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65200cb8c0 con 0x7f65201554e0 2024-04-25T13:17:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f6517fff640 1 --2- 172.21.15.26:0/1157748037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b3c00 0x7f65200b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.245+0000 7f651e59c640 1 --2- 172.21.15.26:0/1157748037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65201554e0 0x7f652015f0f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65200caf10 tx=0x7f651002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f344b8bcfc69e94d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f651dd9b640 1 -- 172.21.15.26:0/1157748037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510037070 con 0x7f65201554e0 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f651dd9b640 1 -- 172.21.15.26:0/1157748037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6510032440 con 0x7f65201554e0 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f651dd9b640 1 -- 172.21.15.26:0/1157748037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510032810 con 0x7f65201554e0 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 -- 172.21.15.26:0/1157748037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65201554e0 msgr2=0x7f652015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 --2- 172.21.15.26:0/1157748037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65201554e0 0x7f652015f0f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65200caf10 tx=0x7f651002a270 comp rx=0 tx=0).stop 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 -- 172.21.15.26:0/1157748037 shutdown_connections 2024-04-25T13:17:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 --2- 172.21.15.26:0/1157748037 >> v2:172.21.15.169:3300/0 conn(0x7f65200b5450 0x7f65200d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 --2- 172.21.15.26:0/1157748037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b3c00 0x7f65200b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 --2- 172.21.15.26:0/1157748037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65201554e0 0x7f652015f0f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 -- 172.21.15.26:0/1157748037 >> 172.21.15.26:0/1157748037 conn(0x7f6520074d50 msgr2=0x7f6520075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 -- 172.21.15.26:0/1157748037 shutdown_connections 2024-04-25T13:17:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.246+0000 7f65248a7640 1 -- 172.21.15.26:0/1157748037 wait complete. 2024-04-25T13:17:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 Processor -- start 2024-04-25T13:17:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 -- start start 2024-04-25T13:17:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200b3c00 0x7f6520154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b5450 0x7f65201f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65201554e0 0x7f65201f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f65200b4430 con 0x7f65200b3c00 2024-04-25T13:17:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65200b4150 con 0x7f65201554e0 2024-04-25T13:17:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f65248a7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f65200b4710 con 0x7f65200b5450 2024-04-25T13:17:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f651e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200b3c00 0x7f6520154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f651e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200b3c00 0x7f6520154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60358/0 (socket says 172.21.15.26:60358) 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.248+0000 7f651e59c640 1 -- 172.21.15.26:0/3640377918 learned_addr learned my addr 172.21.15.26:0/3640377918 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651ed9d640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65201554e0 0x7f65201f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f6517fff640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b5450 0x7f65201f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651e59c640 1 -- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b5450 msgr2=0x7f65201f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651e59c640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b5450 0x7f65201f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651e59c640 1 -- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65201554e0 msgr2=0x7f65201f0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651e59c640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65201554e0 0x7f65201f0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651e59c640 1 -- 172.21.15.26:0/3640377918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65201f1ad0 con 0x7f65200b3c00 2024-04-25T13:17:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651ed9d640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65201554e0 0x7f65201f0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f651e59c640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200b3c00 0x7f6520154080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6510000c00 tx=0x7f65100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f6516ffd640 1 -- 172.21.15.26:0/3640377918 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510041020 con 0x7f65200b3c00 2024-04-25T13:17:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f6516ffd640 1 -- 172.21.15.26:0/3640377918 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65100306c0 con 0x7f65200b3c00 2024-04-25T13:17:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65201f17f0 con 0x7f65200b3c00 2024-04-25T13:17:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f6516ffd640 1 -- 172.21.15.26:0/3640377918 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510037040 con 0x7f65200b3c00 2024-04-25T13:17:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.249+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652015e280 con 0x7f65200b3c00 2024-04-25T13:17:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.250+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6520068e40 con 0x7f65200b3c00 2024-04-25T13:17:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.251+0000 7f6516ffd640 1 -- 172.21.15.26:0/3640377918 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6510044020 con 0x7f65200b3c00 2024-04-25T13:17:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.251+0000 7f6516ffd640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f650006c8f0 0x7f650006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.251+0000 7f6516ffd640 1 -- 172.21.15.26:0/3640377918 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f65100ac7b0 con 0x7f65200b3c00 2024-04-25T13:17:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.251+0000 7f6517fff640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f650006c8f0 0x7f650006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.252+0000 7f6517fff640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f650006c8f0 0x7f650006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6520154b10 tx=0x7f6508008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.256+0000 7f6516ffd640 1 -- 172.21.15.26:0/3640377918 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f651004b030 con 0x7f65200b3c00 2024-04-25T13:17:26.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.444+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f65200cd8a0 con 0x7f650006c8f0 2024-04-25T13:17:26.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.445+0000 7f6516ffd640 1 -- 172.21.15.26:0/3640377918 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f65200cd8a0 con 0x7f650006c8f0 2024-04-25T13:17:26.446 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T13:17:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f650006c8f0 msgr2=0x7f650006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f650006c8f0 0x7f650006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6520154b10 tx=0x7f6508008040 comp rx=0 tx=0).stop 2024-04-25T13:17:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200b3c00 msgr2=0x7f6520154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200b3c00 0x7f6520154080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6510000c00 tx=0x7f65100046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 shutdown_connections 2024-04-25T13:17:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f650006c8f0 0x7f650006edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65201554e0 0x7f65201f0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65200b5450 0x7f65201f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 --2- 172.21.15.26:0/3640377918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200b3c00 0x7f6520154080 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 >> 172.21.15.26:0/3640377918 conn(0x7f6520074d50 msgr2=0x7f6520072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 shutdown_connections 2024-04-25T13:17:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.447+0000 7f65248a7640 1 -- 172.21.15.26:0/3640377918 wait complete. 2024-04-25T13:17:26.459 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T13:17:26.460 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:26.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.567+0000 7fd7a29cc640 1 Processor -- start 2024-04-25T13:17:26.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.567+0000 7fd7a29cc640 1 -- start start 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd7a29cc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd79c0c5b10 0x7fd79c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd7a29cc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 0x7fd79c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd7a29cc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79c15be80 con 0x7fd79c1554d0 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd7a29cc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd79c1558b0 con 0x7fd79c0c5b10 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd7a29cc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c0c6a30 con 0x7fd79c0cbcf0 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd79c1554d0 0x7fd79c0c6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36842/0 (socket says 172.21.15.26:36842) 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79bfff640 1 -- 172.21.15.26:0/4169742194 learned_addr learned my addr 172.21.15.26:0/4169742194 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd7a0f69640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 0x7fd79c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/4169742194 >> v2:172.21.15.169:3300/0 conn(0x7fd79c0c5b10 0x7fd79c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503145081 0 0) 0x7fd79c15be80 con 0x7fd79c1554d0 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd784003520 con 0x7fd79c1554d0 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4243308488 0 0) 0x7fd784003520 con 0x7fd79c1554d0 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 msgr2=0x7fd79c15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 0x7fd79c15b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 >> v2:172.21.15.169:3300/0 conn(0x7fd79c0c5b10 msgr2=0x7fd79c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 --2- 172.21.15.26:0/4169742194 >> v2:172.21.15.169:3300/0 conn(0x7fd79c0c5b10 0x7fd79c0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c0c6100 con 0x7fd79c1554d0 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7fd790001670 con 0x7fd79c1554d0 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 >> v1:172.21.15.26:6789/0 conn(0x7fd79c1554d0 legacy=0x7fd79c0c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7840039b0 0x7fd784003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd784004800 0x7fd784004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 0x7fd7840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c1558b0 con 0x7fd784004800 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0c6a30 con 0x7fd7840039b0 2024-04-25T13:17:26.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd78400b9c0 con 0x7fd79c0cbcf0 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.568+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd784004800 0x7fd784004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd79bfff640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7840039b0 0x7fd784003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd7a0f69640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 0x7fd7840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd79b7fe640 1 -- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 msgr2=0x7fd7840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd79c0cbcf0 0x7fd7840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd79b7fe640 1 -- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7840039b0 msgr2=0x7fd784003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7840039b0 0x7fd784003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd79b7fe640 1 -- 172.21.15.26:0/4169742194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd784003520 con 0x7fd784004800 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.569+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd784004800 0x7fd784004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009ab0 tx=0x7fd784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed271d97919936a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c036070 con 0x7fd784004800 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c005990 con 0x7fd784004800 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd79affd640 1 -- 172.21.15.26:0/4169742194 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c009680 con 0x7fd784004800 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd7a29cc640 1 -- 172.21.15.26:0/4169742194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd784004800 msgr2=0x7fd784004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd7a29cc640 1 --2- 172.21.15.26:0/4169742194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd784004800 0x7fd784004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009ab0 tx=0x7fd784005830 comp rx=0 tx=0).stop 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd7a0f69640 1 -- 172.21.15.26:0/4169742194 reap_dead start 2024-04-25T13:17:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd7a29cc640 1 -- 172.21.15.26:0/4169742194 shutdown_connections 2024-04-25T13:17:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd7a29cc640 1 -- 172.21.15.26:0/4169742194 >> 172.21.15.26:0/4169742194 conn(0x7fd79c068360 msgr2=0x7fd79c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd7a29cc640 1 -- 172.21.15.26:0/4169742194 shutdown_connections 2024-04-25T13:17:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.570+0000 7fd7a29cc640 1 -- 172.21.15.26:0/4169742194 wait complete. 2024-04-25T13:17:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.571+0000 7fd7a29cc640 1 Processor -- start 2024-04-25T13:17:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.571+0000 7fd7a29cc640 1 -- start start 2024-04-25T13:17:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a29cc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd784004800 0x7fd79c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a29cc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd79c15ee60 0x7fd79c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a29cc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd79c1e7fb0 0x7fd79c14b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a29cc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0c66c0 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a29cc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c15c160 con 0x7fd79c15ee60 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a29cc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c0ccc20 con 0x7fd784004800 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a0f69640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd79c1e7fb0 0x7fd79c14b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a0f69640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd79c1e7fb0 0x7fd79c14b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60386/0 (socket says 172.21.15.26:60386) 2024-04-25T13:17:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd7a0f69640 1 -- 172.21.15.26:0/3652394628 learned_addr learned my addr 172.21.15.26:0/3652394628 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd79bfff640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd784004800 0x7fd79c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.572+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd79c15ee60 0x7fd79c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a0f69640 1 -- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd784004800 msgr2=0x7fd79c158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a0f69640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd784004800 0x7fd79c158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a0f69640 1 -- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd79c15ee60 msgr2=0x7fd79c150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a0f69640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd79c15ee60 0x7fd79c150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a0f69640 1 -- 172.21.15.26:0/3652394628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c15cac0 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a0f69640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd79c1e7fb0 0x7fd79c14b030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0caf10 tx=0x7fd7940115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794011de0 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79401b070 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794003990 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c150200 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.573+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c1504a0 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.574+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd79c068f50 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd794005d10 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd798ff9640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd78806c8f0 0x7fd78806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fd79408c0e0 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd798ff9640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7fd788076410 0x7fd7880788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 --> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd794009260 con 0x7fd788076410 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd794093050 con 0x7fd79c1e7fb0 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd79bfff640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd78806c8f0 0x7fd78806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.575+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7fd788076410 0x7fd7880788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.576+0000 7fd79b7fe640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7fd788076410 0x7fd7880788b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.576+0000 7fd79bfff640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd78806c8f0 0x7fd78806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7900015d0 tx=0x7fd7900078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.576+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== osd.2 v2:172.21.15.26:6808/1245488833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd794009260 con 0x7fd788076410 2024-04-25T13:17:26.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.589+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 --> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd79c14f550 con 0x7fd788076410 2024-04-25T13:17:26.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd798ff9640 1 -- 172.21.15.26:0/3652394628 <== osd.2 v2:172.21.15.26:6808/1245488833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd79c14f550 con 0x7fd788076410 2024-04-25T13:17:26.590 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:26.590 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:26.590 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:26.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7fd788076410 msgr2=0x7fd7880788b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:6808/1245488833,v1:172.21.15.26:6809/1245488833] conn(0x7fd788076410 0x7fd7880788b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd78806c8f0 msgr2=0x7fd78806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fd78806c8f0 0x7fd78806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7900015d0 tx=0x7fd7900078f0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd79c1e7fb0 msgr2=0x7fd79c14b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 --2- 172.21.15.26:0/3652394628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd79c1e7fb0 0x7fd79c14b030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0caf10 tx=0x7fd7940115a0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a0f69640 1 -- 172.21.15.26:0/3652394628 reap_dead start 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 shutdown_connections 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 >> 172.21.15.26:0/3652394628 conn(0x7fd79c068360 msgr2=0x7fd79c0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 shutdown_connections 2024-04-25T13:17:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.590+0000 7fd7a29cc640 1 -- 172.21.15.26:0/3652394628 wait complete. 2024-04-25T13:17:26.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T13:17:26.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.706+0000 7f5bcbc12640 1 Processor -- start 2024-04-25T13:17:26.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.706+0000 7f5bcbc12640 1 -- start start 2024-04-25T13:17:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bcbc12640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bc40b3c00 0x7f5bc40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bcbc12640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc40b5450 0x7f5bc40d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bcbc12640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc41558c0 con 0x7f5bc41554e0 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bcbc12640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5bc40b4a80 con 0x7f5bc40b3c00 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bcbc12640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc40cb8c0 con 0x7f5bc40b5450 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc91ad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bc40b3c00 0x7f5bc40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc99ae640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5bc41554e0 0x7f5bc415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36844/0 (socket says 172.21.15.26:36844) 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc91ad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bc40b3c00 0x7f5bc40b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60392/0 (socket says 172.21.15.26:60392) 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc99ae640 1 -- 172.21.15.26:0/2075720353 learned_addr learned my addr 172.21.15.26:0/2075720353 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:26.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bca1af640 1 --2- 172.21.15.26:0/2075720353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc40b5450 0x7f5bc40d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc91ad640 1 -- 172.21.15.26:0/2075720353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc40b5450 msgr2=0x7f5bc40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:26.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc91ad640 1 --2- 172.21.15.26:0/2075720353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc40b5450 0x7f5bc40d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc91ad640 1 -- 172.21.15.26:0/2075720353 >> v1:172.21.15.26:6789/0 conn(0x7f5bc41554e0 legacy=0x7f5bc415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc89ac640 1 -- 172.21.15.26:0/2075720353 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610187508 0 0) 0x7f5bc0001110 con 0x7f5bc41554e0 2024-04-25T13:17:26.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.707+0000 7f5bc91ad640 1 -- 172.21.15.26:0/2075720353 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc40cbba0 con 0x7f5bc40b3c00 2024-04-25T13:17:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.708+0000 7f5bc91ad640 1 --2- 172.21.15.26:0/2075720353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40b4f10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40097a0 tx=0x7f5bb402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ff7bc818348bcf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.708+0000 7f5bc89ac640 1 -- 172.21.15.26:0/2075720353 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4037070 con 0x7f5bc40b3c00 2024-04-25T13:17:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.708+0000 7f5bc89ac640 1 -- 172.21.15.26:0/2075720353 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb4032440 con 0x7f5bc40b3c00 2024-04-25T13:17:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.708+0000 7f5bc89ac640 1 -- 172.21.15.26:0/2075720353 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4032810 con 0x7f5bc40b3c00 2024-04-25T13:17:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 -- 172.21.15.26:0/2075720353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b3c00 msgr2=0x7f5bc40b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/2075720353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40b4f10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40097a0 tx=0x7f5bb402a210 comp rx=0 tx=0).stop 2024-04-25T13:17:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 -- 172.21.15.26:0/2075720353 shutdown_connections 2024-04-25T13:17:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/2075720353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc40b5450 0x7f5bc40d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/2075720353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40b4f10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 -- 172.21.15.26:0/2075720353 >> 172.21.15.26:0/2075720353 conn(0x7f5bc4074d50 msgr2=0x7f5bc4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 -- 172.21.15.26:0/2075720353 shutdown_connections 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.709+0000 7f5bcbc12640 1 -- 172.21.15.26:0/2075720353 wait complete. 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.710+0000 7f5bcbc12640 1 Processor -- start 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.710+0000 7f5bcbc12640 1 -- start start 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bcbc12640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bcbc12640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b5450 0x7f5bc40c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bcbc12640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc41554e0 0x7f5bc40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bcbc12640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc40b4710 con 0x7f5bc40b5450 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bcbc12640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc40b4430 con 0x7f5bc40b3c00 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bcbc12640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc40b3580 con 0x7f5bc41554e0 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b5450 0x7f5bc40c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b5450 0x7f5bc40c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60408/0 (socket says 172.21.15.26:60408) 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 -- 172.21.15.26:0/3444869709 learned_addr learned my addr 172.21.15.26:0/3444869709 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:26.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bca1af640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc41554e0 0x7f5bc40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc99ae640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 -- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc41554e0 msgr2=0x7f5bc40c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc41554e0 0x7f5bc40c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 -- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc40b3c00 msgr2=0x7f5bc40cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 -- 172.21.15.26:0/3444869709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc41f42a0 con 0x7f5bc40b5450 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc99ae640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bca1af640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc41554e0 0x7f5bc40c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bc91ad640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b5450 0x7f5bc40c6b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4035040 tx=0x7f5bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bba7fc640 1 -- 172.21.15.26:0/3444869709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4037040 con 0x7f5bc40b5450 2024-04-25T13:17:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bba7fc640 1 -- 172.21.15.26:0/3444869709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb4030500 con 0x7f5bc40b5450 2024-04-25T13:17:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bba7fc640 1 -- 172.21.15.26:0/3444869709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4030910 con 0x7f5bc40b5450 2024-04-25T13:17:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.711+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc41f4560 con 0x7f5bc40b5450 2024-04-25T13:17:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.712+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc41f4b20 con 0x7f5bc40b5450 2024-04-25T13:17:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.712+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc40cd3e0 con 0x7f5bc40b5450 2024-04-25T13:17:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.713+0000 7f5bba7fc640 1 -- 172.21.15.26:0/3444869709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bb4044020 con 0x7f5bc40b5450 2024-04-25T13:17:26.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.713+0000 7f5bba7fc640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5ba806c920 0x7f5ba806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:26.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.713+0000 7f5bba7fc640 1 -- 172.21.15.26:0/3444869709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f5bb40ac200 con 0x7f5bc40b5450 2024-04-25T13:17:26.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.714+0000 7f5bc99ae640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5ba806c920 0x7f5ba806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:26.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.714+0000 7f5bc99ae640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5ba806c920 0x7f5ba806ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0000f60 tx=0x7f5bc0007a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:26.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.718+0000 7f5bba7fc640 1 -- 172.21.15.26:0/3444869709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5bb407a1e0 con 0x7f5bc40b5450 2024-04-25T13:17:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.903+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5bc4068e20 con 0x7f5ba806c920 2024-04-25T13:17:26.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.904+0000 7f5bba7fc640 1 -- 172.21.15.26:0/3444869709 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5bc4068e20 con 0x7f5ba806c920 2024-04-25T13:17:26.904 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T13:17:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5ba806c920 msgr2=0x7f5ba806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5ba806c920 0x7f5ba806ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0000f60 tx=0x7f5bc0007a10 comp rx=0 tx=0).stop 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b5450 msgr2=0x7f5bc40c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b5450 0x7f5bc40c6b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4035040 tx=0x7f5bb40046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 shutdown_connections 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f5ba806c920 0x7f5ba806ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5bc41554e0 0x7f5bc40c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bc40b5450 0x7f5bc40c6b20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 --2- 172.21.15.26:0/3444869709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bc40b3c00 0x7f5bc40cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:26.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 >> 172.21.15.26:0/3444869709 conn(0x7f5bc4074d50 msgr2=0x7f5bc4153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:26.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 shutdown_connections 2024-04-25T13:17:26.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:26.906+0000 7f5bcbc12640 1 -- 172.21.15.26:0/3444869709 wait complete. 2024-04-25T13:17:26.917 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T13:17:26.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.023+0000 7f0ab844e640 1 Processor -- start 2024-04-25T13:17:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.023+0000 7f0ab844e640 1 -- start start 2024-04-25T13:17:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab844e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab0158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab844e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab00c9f60 con 0x7f0ab01594b0 2024-04-25T13:17:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab844e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab015c1d0 con 0x7f0ab00c8790 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab844e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab0158c60 con 0x7f0ab00c83b0 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab69eb640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0ab01594b0 0x7f0ab0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36850/0 (socket says 172.21.15.26:36850) 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab69eb640 1 -- 172.21.15.26:0/3716853687 learned_addr learned my addr 172.21.15.26:0/3716853687 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab61ea640 1 --2- 172.21.15.26:0/3716853687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab0158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab51e8640 1 -- 172.21.15.26:0/3716853687 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592968394 0 0) 0x7f0ab00c9f60 con 0x7f0ab01594b0 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab51e8640 1 -- 172.21.15.26:0/3716853687 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a9c003520 con 0x7f0ab01594b0 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab61ea640 1 -- 172.21.15.26:0/3716853687 >> v1:172.21.15.169:6789/0 conn(0x7f0ab00c8790 legacy=0x7f0ab00c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab61ea640 1 -- 172.21.15.26:0/3716853687 >> v1:172.21.15.26:6789/0 conn(0x7f0ab01594b0 legacy=0x7f0ab0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.024+0000 7f0ab61ea640 1 -- 172.21.15.26:0/3716853687 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab015b370 con 0x7f0ab00c83b0 2024-04-25T13:17:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.025+0000 7f0ab61ea640 1 --2- 172.21.15.26:0/3716853687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab0158720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0097d0 tx=0x7f0aac02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51304b47ae7cb30b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.025+0000 7f0ab51e8640 1 -- 172.21.15.26:0/3716853687 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac037070 con 0x7f0ab00c83b0 2024-04-25T13:17:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.025+0000 7f0ab51e8640 1 -- 172.21.15.26:0/3716853687 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac032440 con 0x7f0ab00c83b0 2024-04-25T13:17:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.025+0000 7f0ab51e8640 1 -- 172.21.15.26:0/3716853687 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0327f0 con 0x7f0ab00c83b0 2024-04-25T13:17:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.026+0000 7f0ab844e640 1 -- 172.21.15.26:0/3716853687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 msgr2=0x7f0ab0158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.026+0000 7f0ab844e640 1 --2- 172.21.15.26:0/3716853687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab0158720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0097d0 tx=0x7f0aac02a290 comp rx=0 tx=0).stop 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.026+0000 7f0ab844e640 1 -- 172.21.15.26:0/3716853687 shutdown_connections 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.026+0000 7f0ab844e640 1 --2- 172.21.15.26:0/3716853687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab0158720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.026+0000 7f0ab844e640 1 -- 172.21.15.26:0/3716853687 >> 172.21.15.26:0/3716853687 conn(0x7f0ab0068120 msgr2=0x7f0ab006eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.026+0000 7f0ab844e640 1 -- 172.21.15.26:0/3716853687 shutdown_connections 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.026+0000 7f0ab844e640 1 -- 172.21.15.26:0/3716853687 wait complete. 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.027+0000 7f0ab844e640 1 Processor -- start 2024-04-25T13:17:27.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.027+0000 7f0ab844e640 1 -- start start 2024-04-25T13:17:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab844e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab00c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab844e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab00c8790 0x7f0ab00be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab844e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab01594b0 0x7f0ab01f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab844e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab015bc10 con 0x7f0ab01594b0 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab844e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab015b930 con 0x7f0ab00c8790 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab844e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab015bef0 con 0x7f0ab00c83b0 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab01594b0 0x7f0ab01f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab01594b0 0x7f0ab01f0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60420/0 (socket says 172.21.15.26:60420) 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 -- 172.21.15.26:0/442857393 learned_addr learned my addr 172.21.15.26:0/442857393 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab61ea640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab00c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab59e9640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab00c8790 0x7f0ab00be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 -- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 msgr2=0x7f0ab00c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ab00c83b0 0x7f0ab00c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 -- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab00c8790 msgr2=0x7f0ab00be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab00c8790 0x7f0ab00be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 -- 172.21.15.26:0/442857393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab00c3170 con 0x7f0ab01594b0 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.028+0000 7f0ab69eb640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab01594b0 0x7f0ab01f0da0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800cb70 tx=0x7f0aa800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.029+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8017070 con 0x7f0ab01594b0 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.029+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa800ad40 con 0x7f0ab01594b0 2024-04-25T13:17:27.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.029+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab0072800 con 0x7f0ab01594b0 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.029+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8012620 con 0x7f0ab01594b0 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.029+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab00733b0 con 0x7f0ab01594b0 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.029+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ab0068f50 con 0x7f0ab01594b0 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.030+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0aa801a070 con 0x7f0ab01594b0 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.030+0000 7f0aa6ffd640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0a9406c920 0x7f0a9406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f0aa808bd60 con 0x7f0ab01594b0 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0ab61ea640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0a9406c920 0x7f0a9406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0aa6ffd640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f0a94076440 0x7f0a940788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 --> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a94078fb0 con 0x7f0a94076440 2024-04-25T13:17:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0aa808e400 con 0x7f0ab01594b0 2024-04-25T13:17:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0ab59e9640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f0a94076440 0x7f0a940788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0ab61ea640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0a9406c920 0x7f0a9406ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0aac034000 tx=0x7f0aac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.031+0000 7f0ab59e9640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f0a94076440 0x7f0a940788e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.032+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== osd.3 v2:172.21.15.26:6824/3590411791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a94078fb0 con 0x7f0a94076440 2024-04-25T13:17:27.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.045+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 --> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0ab00cae40 con 0x7f0a94076440 2024-04-25T13:17:27.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.045+0000 7f0aa6ffd640 1 -- 172.21.15.26:0/442857393 <== osd.3 v2:172.21.15.26:6824/3590411791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0ab00cae40 con 0x7f0a94076440 2024-04-25T13:17:27.045 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:27.045 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:27.046 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f0a94076440 msgr2=0x7f0a940788e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:6824/3590411791,v1:172.21.15.26:6825/3590411791] conn(0x7f0a94076440 0x7f0a940788e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0a9406c920 msgr2=0x7f0a9406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f0a9406c920 0x7f0a9406ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0aac034000 tx=0x7f0aac02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab01594b0 msgr2=0x7f0ab01f0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 --2- 172.21.15.26:0/442857393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab01594b0 0x7f0ab01f0da0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800cb70 tx=0x7f0aa800a430 comp rx=0 tx=0).stop 2024-04-25T13:17:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab69eb640 1 -- 172.21.15.26:0/442857393 reap_dead start 2024-04-25T13:17:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 shutdown_connections 2024-04-25T13:17:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 >> 172.21.15.26:0/442857393 conn(0x7f0ab0068120 msgr2=0x7f0ab00c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 shutdown_connections 2024-04-25T13:17:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.046+0000 7f0ab844e640 1 -- 172.21.15.26:0/442857393 wait complete. 2024-04-25T13:17:27.056 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T13:17:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.158+0000 7f20a69d8640 1 Processor -- start 2024-04-25T13:17:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.158+0000 7f20a69d8640 1 -- start start 2024-04-25T13:17:27.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f20a69d8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20a006bf70 0x7f20a015af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f20a69d8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a015bef0 con 0x7f20a006bb90 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f20a69d8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a015b650 con 0x7f20a00c99f0 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f20a69d8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f20a015f510 con 0x7f20a006bf70 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f209ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f20a006bb90 0x7f20a015ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36860/0 (socket says 172.21.15.26:36860) 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f209ffff640 1 -- 172.21.15.26:0/831525896 learned_addr learned my addr 172.21.15.26:0/831525896 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f209f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20a006bf70 0x7f20a015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.159+0000 7f209effd640 1 -- 172.21.15.26:0/831525896 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094773923 0 0) 0x7f20a015bef0 con 0x7f20a006bb90 2024-04-25T13:17:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209effd640 1 -- 172.21.15.26:0/831525896 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f208c003520 con 0x7f20a006bb90 2024-04-25T13:17:27.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209f7fe640 1 -- 172.21.15.26:0/831525896 >> v1:172.21.15.169:6789/0 conn(0x7f20a00c99f0 legacy=0x7f20a0154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:27.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209f7fe640 1 -- 172.21.15.26:0/831525896 >> v1:172.21.15.26:6789/0 conn(0x7f20a006bb90 legacy=0x7f20a015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209f7fe640 1 -- 172.21.15.26:0/831525896 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a015b930 con 0x7f20a006bf70 2024-04-25T13:17:27.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209f7fe640 1 --2- 172.21.15.26:0/831525896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a006bf70 0x7f20a015af70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f20900097a0 tx=0x7f209002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6847a096cc1e1d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209effd640 1 -- 172.21.15.26:0/831525896 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090037070 con 0x7f20a006bf70 2024-04-25T13:17:27.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209effd640 1 -- 172.21.15.26:0/831525896 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2090032440 con 0x7f20a006bf70 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.160+0000 7f209effd640 1 -- 172.21.15.26:0/831525896 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090032810 con 0x7f20a006bf70 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.161+0000 7f20a69d8640 1 -- 172.21.15.26:0/831525896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a006bf70 msgr2=0x7f20a015af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.161+0000 7f20a69d8640 1 --2- 172.21.15.26:0/831525896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a006bf70 0x7f20a015af70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f20900097a0 tx=0x7f209002a270 comp rx=0 tx=0).stop 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.161+0000 7f20a69d8640 1 -- 172.21.15.26:0/831525896 shutdown_connections 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.161+0000 7f20a69d8640 1 --2- 172.21.15.26:0/831525896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a006bf70 0x7f20a015af70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.161+0000 7f20a69d8640 1 -- 172.21.15.26:0/831525896 >> 172.21.15.26:0/831525896 conn(0x7f20a0074d50 msgr2=0x7f20a0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.161+0000 7f20a69d8640 1 -- 172.21.15.26:0/831525896 shutdown_connections 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.161+0000 7f20a69d8640 1 -- 172.21.15.26:0/831525896 wait complete. 2024-04-25T13:17:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.162+0000 7f20a69d8640 1 Processor -- start 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.162+0000 7f20a69d8640 1 -- start start 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a69d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20a006bb90 0x7f20a014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a69d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20a006bf70 0x7f20a0159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a69d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a00c99f0 0x7f20a015d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a69d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f20a015e8e0 con 0x7f20a00c99f0 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a69d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20a015e600 con 0x7f20a006bb90 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a69d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f20a0074560 con 0x7f20a006bf70 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a00c99f0 0x7f20a015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a00c99f0 0x7f20a015d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60440/0 (socket says 172.21.15.26:60440) 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 -- 172.21.15.26:0/2253532936 learned_addr learned my addr 172.21.15.26:0/2253532936 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f209f7fe640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20a006bf70 0x7f20a0159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f209ffff640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20a006bb90 0x7f20a014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 -- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20a006bf70 msgr2=0x7f20a0159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20a006bf70 0x7f20a0159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 -- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20a006bb90 msgr2=0x7f20a014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20a006bb90 0x7f20a014afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f20a4f75640 1 -- 172.21.15.26:0/2253532936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a0158ca0 con 0x7f20a00c99f0 2024-04-25T13:17:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.163+0000 7f209ffff640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20a006bb90 0x7f20a014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.164+0000 7f20a4f75640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a00c99f0 0x7f20a015d390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f209800c780 tx=0x7f209800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.164+0000 7f209cff9640 1 -- 172.21.15.26:0/2253532936 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098004b60 con 0x7f20a00c99f0 2024-04-25T13:17:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.164+0000 7f209cff9640 1 -- 172.21.15.26:0/2253532936 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098004d00 con 0x7f20a00c99f0 2024-04-25T13:17:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.164+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a01f1610 con 0x7f20a00c99f0 2024-04-25T13:17:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.164+0000 7f209cff9640 1 -- 172.21.15.26:0/2253532936 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209800aa90 con 0x7f20a00c99f0 2024-04-25T13:17:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.164+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a015ee00 con 0x7f20a00c99f0 2024-04-25T13:17:27.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.165+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a0069e50 con 0x7f20a00c99f0 2024-04-25T13:17:27.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.165+0000 7f209cff9640 1 -- 172.21.15.26:0/2253532936 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f209800ac30 con 0x7f20a00c99f0 2024-04-25T13:17:27.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.166+0000 7f209cff9640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f208006c920 0x7f208006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.166+0000 7f209cff9640 1 -- 172.21.15.26:0/2253532936 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f209808c1f0 con 0x7f20a00c99f0 2024-04-25T13:17:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.166+0000 7f209ffff640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f208006c920 0x7f208006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.166+0000 7f209ffff640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f208006c920 0x7f208006ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2088007fd0 tx=0x7f2088009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.170+0000 7f209cff9640 1 -- 172.21.15.26:0/2253532936 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f20a0069e50 con 0x7f20a00c99f0 2024-04-25T13:17:27.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.357+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f20a0068e40 con 0x7f208006c920 2024-04-25T13:17:27.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.358+0000 7f209cff9640 1 -- 172.21.15.26:0/2253532936 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f20a0068e40 con 0x7f208006c920 2024-04-25T13:17:27.358 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T13:17:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f208006c920 msgr2=0x7f208006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f208006c920 0x7f208006ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2088007fd0 tx=0x7f2088009040 comp rx=0 tx=0).stop 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a00c99f0 msgr2=0x7f20a015d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a00c99f0 0x7f20a015d390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f209800c780 tx=0x7f209800cc40 comp rx=0 tx=0).stop 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 shutdown_connections 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f208006c920 0x7f208006ede0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a00c99f0 0x7f20a015d390 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20a006bf70 0x7f20a0159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 --2- 172.21.15.26:0/2253532936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20a006bb90 0x7f20a014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 >> 172.21.15.26:0/2253532936 conn(0x7f20a0074d50 msgr2=0x7f20a00ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 shutdown_connections 2024-04-25T13:17:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.360+0000 7f20a69d8640 1 -- 172.21.15.26:0/2253532936 wait complete. 2024-04-25T13:17:27.371 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T13:17:27.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:27.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.479+0000 7f6206f20640 1 Processor -- start 2024-04-25T13:17:27.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.479+0000 7f6206f20640 1 -- start start 2024-04-25T13:17:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.479+0000 7f6206f20640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62001556d0 0x7f620015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.479+0000 7f6206f20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62000d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.479+0000 7f6206f20640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62000cbb60 con 0x7f62000d0dd0 2024-04-25T13:17:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.479+0000 7f6206f20640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f62000b35b0 con 0x7f62001556d0 2024-04-25T13:17:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.479+0000 7f6206f20640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62000b3990 con 0x7f62000cc600 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f61fffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62000d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f6204cbc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62001556d0 0x7f620015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f62054bd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f62000d0dd0 0x7f62000cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:48372/0 (socket says 172.21.15.26:48372) 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f61fffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62000d0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:41268/0 (socket says 172.21.15.26:41268) 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f62054bd640 1 -- 172.21.15.26:0/1004551317 learned_addr learned my addr 172.21.15.26:0/1004551317 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f61fffff640 1 -- 172.21.15.26:0/1004551317 >> v2:172.21.15.169:3300/0 conn(0x7f62001556d0 msgr2=0x7f620015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f61fffff640 1 --2- 172.21.15.26:0/1004551317 >> v2:172.21.15.169:3300/0 conn(0x7f62001556d0 0x7f620015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f61fffff640 1 -- 172.21.15.26:0/1004551317 >> v1:172.21.15.169:6789/0 conn(0x7f62000d0dd0 legacy=0x7f62000cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f61fffff640 1 -- 172.21.15.26:0/1004551317 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62000cb5a0 con 0x7f62000cc600 2024-04-25T13:17:27.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.480+0000 7f6204cbc640 1 --2- 172.21.15.26:0/1004551317 >> v2:172.21.15.169:3300/0 conn(0x7f62001556d0 0x7f620015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.481+0000 7f61fffff640 1 --2- 172.21.15.26:0/1004551317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62000d0890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0097a0 tx=0x7f61ec02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01dd8336e45fdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.481+0000 7f61ff7fe640 1 -- 172.21.15.26:0/1004551317 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec037070 con 0x7f62000cc600 2024-04-25T13:17:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.481+0000 7f61ff7fe640 1 -- 172.21.15.26:0/1004551317 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec032440 con 0x7f62000cc600 2024-04-25T13:17:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.481+0000 7f61ff7fe640 1 -- 172.21.15.26:0/1004551317 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec032810 con 0x7f62000cc600 2024-04-25T13:17:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 -- 172.21.15.26:0/1004551317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 msgr2=0x7f62000d0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 --2- 172.21.15.26:0/1004551317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62000d0890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0097a0 tx=0x7f61ec02a180 comp rx=0 tx=0).stop 2024-04-25T13:17:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 -- 172.21.15.26:0/1004551317 shutdown_connections 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 --2- 172.21.15.26:0/1004551317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62000d0890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 --2- 172.21.15.26:0/1004551317 >> v2:172.21.15.169:3300/0 conn(0x7f62001556d0 0x7f620015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 -- 172.21.15.26:0/1004551317 >> 172.21.15.26:0/1004551317 conn(0x7f6200068360 msgr2=0x7f6200074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 -- 172.21.15.26:0/1004551317 shutdown_connections 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.482+0000 7f6206f20640 1 -- 172.21.15.26:0/1004551317 wait complete. 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.483+0000 7f6206f20640 1 Processor -- start 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.483+0000 7f6206f20640 1 -- start start 2024-04-25T13:17:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62001f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62000d0dd0 0x7f62000c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62001556d0 0x7f62000c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f62000cbd70 con 0x7f62001556d0 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62000b3c30 con 0x7f62000d0dd0 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62000cbef0 con 0x7f62000cc600 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62001556d0 0x7f62000c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62001556d0 0x7f62000c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60452/0 (socket says 172.21.15.26:60452) 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 -- 172.21.15.26:0/2216244616 learned_addr learned my addr 172.21.15.26:0/2216244616 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f61fffff640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62000d0dd0 0x7f62000c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6204cbc640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62001f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 -- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 msgr2=0x7f62001f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62000cc600 0x7f62001f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 -- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62000d0dd0 msgr2=0x7f62000c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62000d0dd0 0x7f62000c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 -- 172.21.15.26:0/2216244616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62000c7370 con 0x7f62001556d0 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f62054bd640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62001556d0 0x7f62000c8840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61f800cbc0 tx=0x7f61f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8017070 con 0x7f62001556d0 2024-04-25T13:17:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f800ad40 con 0x7f62001556d0 2024-04-25T13:17:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6200155d10 con 0x7f62001556d0 2024-04-25T13:17:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8012600 con 0x7f62001556d0 2024-04-25T13:17:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.484+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62001562d0 con 0x7f62001556d0 2024-04-25T13:17:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.485+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62000c83f0 con 0x7f62001556d0 2024-04-25T13:17:27.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.486+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61f801a070 con 0x7f62001556d0 2024-04-25T13:17:27.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.486+0000 7f61fd7fa640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.486+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f61f808c4a0 con 0x7f62001556d0 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.487+0000 7f61fd7fa640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f61e4076400 0x7f61e40788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.487+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 --> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61e4078f70 con 0x7f61e4076400 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.487+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f61f808c930 con 0x7f62001556d0 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.487+0000 7f6204cbc640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.487+0000 7f61fffff640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f61e4076400 0x7f61e40788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.487+0000 7f6204cbc640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f61e406c8f0 0x7f61e406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009560 tx=0x7f61f4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.487+0000 7f61fffff640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f61e4076400 0x7f61e40788a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.488+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== osd.4 v2:172.21.15.169:6816/1358743323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61e4078f70 con 0x7f61e4076400 2024-04-25T13:17:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.501+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 --> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6200068f50 con 0x7f61e4076400 2024-04-25T13:17:27.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f61fd7fa640 1 -- 172.21.15.26:0/2216244616 <== osd.4 v2:172.21.15.169:6816/1358743323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6200068f50 con 0x7f61e4076400 2024-04-25T13:17:27.502 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:27.502 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:27.503 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:27.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f61e4076400 msgr2=0x7f61e40788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f6206f20640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6816/1358743323,v1:172.21.15.169:6817/1358743323] conn(0x7f61e4076400 0x7f61e40788a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f61e406c8f0 msgr2=0x7f61e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f6206f20640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f61e406c8f0 0x7f61e406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009560 tx=0x7f61f4009190 comp rx=0 tx=0).stop 2024-04-25T13:17:27.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62001556d0 msgr2=0x7f62000c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f6206f20640 1 --2- 172.21.15.26:0/2216244616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62001556d0 0x7f62000c8840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61f800cbc0 tx=0x7f61f800a430 comp rx=0 tx=0).stop 2024-04-25T13:17:27.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.502+0000 7f62054bd640 1 -- 172.21.15.26:0/2216244616 reap_dead start 2024-04-25T13:17:27.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.503+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 shutdown_connections 2024-04-25T13:17:27.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.503+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 >> 172.21.15.26:0/2216244616 conn(0x7f6200068360 msgr2=0x7f62000cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.503+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 shutdown_connections 2024-04-25T13:17:27.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.503+0000 7f6206f20640 1 -- 172.21.15.26:0/2216244616 wait complete. 2024-04-25T13:17:27.513 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T13:17:27.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.614+0000 7f4f82bf7640 1 Processor -- start 2024-04-25T13:17:27.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.614+0000 7f4f82bf7640 1 -- start start 2024-04-25T13:17:27.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f82bf7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c1554e0 0x7f4f7c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f82bf7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f7c0b3c00 0x7f4f7c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f82bf7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c1558c0 con 0x7f4f7c0b5450 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f82bf7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c0b4a80 con 0x7f4f7c0b3c00 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f82bf7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c15f630 con 0x7f4f7c1554e0 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f7bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f7c0b3c00 0x7f4f7c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f81194640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4f7c0b5450 0x7f4f7c0d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36864/0 (socket says 172.21.15.26:36864) 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f81194640 1 -- 172.21.15.26:0/1599231783 learned_addr learned my addr 172.21.15.26:0/1599231783 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f80993640 1 --2- 172.21.15.26:0/1599231783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c1554e0 0x7f4f7c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f7bfff640 1 -- 172.21.15.26:0/1599231783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c1554e0 msgr2=0x7f4f7c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f7bfff640 1 --2- 172.21.15.26:0/1599231783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c1554e0 0x7f4f7c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f7bfff640 1 -- 172.21.15.26:0/1599231783 >> v1:172.21.15.26:6789/0 conn(0x7f4f7c0b5450 legacy=0x7f4f7c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f7bfff640 1 -- 172.21.15.26:0/1599231783 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0cb8c0 con 0x7f4f7c0b3c00 2024-04-25T13:17:27.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.615+0000 7f4f7b7fe640 1 -- 172.21.15.26:0/1599231783 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159657489 0 0) 0x7f4f74001490 con 0x7f4f7c0b5450 2024-04-25T13:17:27.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.616+0000 7f4f7bfff640 1 --2- 172.21.15.26:0/1599231783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c0b3c00 0x7f4f7c0b4f10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4f700097a0 tx=0x7f4f7002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ec2a1697d1807f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.616+0000 7f4f7b7fe640 1 -- 172.21.15.26:0/1599231783 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70037070 con 0x7f4f7c0b3c00 2024-04-25T13:17:27.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.616+0000 7f4f7b7fe640 1 -- 172.21.15.26:0/1599231783 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f70032440 con 0x7f4f7c0b3c00 2024-04-25T13:17:27.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.616+0000 7f4f7b7fe640 1 -- 172.21.15.26:0/1599231783 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70032810 con 0x7f4f7c0b3c00 2024-04-25T13:17:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 -- 172.21.15.26:0/1599231783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c0b3c00 msgr2=0x7f4f7c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/1599231783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c0b3c00 0x7f4f7c0b4f10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4f700097a0 tx=0x7f4f7002a210 comp rx=0 tx=0).stop 2024-04-25T13:17:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 -- 172.21.15.26:0/1599231783 shutdown_connections 2024-04-25T13:17:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/1599231783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c0b3c00 0x7f4f7c0b4f10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/1599231783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c1554e0 0x7f4f7c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 -- 172.21.15.26:0/1599231783 >> 172.21.15.26:0/1599231783 conn(0x7f4f7c074d50 msgr2=0x7f4f7c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 -- 172.21.15.26:0/1599231783 shutdown_connections 2024-04-25T13:17:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.617+0000 7f4f82bf7640 1 -- 172.21.15.26:0/1599231783 wait complete. 2024-04-25T13:17:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.618+0000 7f4f82bf7640 1 Processor -- start 2024-04-25T13:17:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.618+0000 7f4f82bf7640 1 -- start start 2024-04-25T13:17:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f82bf7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f7c0b3c00 0x7f4f7c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f82bf7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c0b5450 0x7f4f7c0c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f82bf7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c1554e0 0x7f4f7c0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f82bf7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b4430 con 0x7f4f7c1554e0 2024-04-25T13:17:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f82bf7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b4150 con 0x7f4f7c0b3c00 2024-04-25T13:17:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f82bf7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b4710 con 0x7f4f7c0b5450 2024-04-25T13:17:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c1554e0 0x7f4f7c0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c1554e0 0x7f4f7c0c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60470/0 (socket says 172.21.15.26:60470) 2024-04-25T13:17:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 -- 172.21.15.26:0/171321850 learned_addr learned my addr 172.21.15.26:0/171321850 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f7bfff640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c0b5450 0x7f4f7c0c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f80993640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f7c0b3c00 0x7f4f7c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 -- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c0b5450 msgr2=0x7f4f7c0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c0b5450 0x7f4f7c0c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 -- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f7c0b3c00 msgr2=0x7f4f7c15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f7c0b3c00 0x7f4f7c15c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f81194640 1 -- 172.21.15.26:0/171321850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c15edb0 con 0x7f4f7c1554e0 2024-04-25T13:17:27.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.619+0000 7f4f7bfff640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c0b5450 0x7f4f7c0c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:27.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.620+0000 7f4f81194640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c1554e0 0x7f4f7c0c5e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400c820 tx=0x7f4f7400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.620+0000 7f4f797fa640 1 -- 172.21.15.26:0/171321850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74018070 con 0x7f4f7c1554e0 2024-04-25T13:17:27.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.620+0000 7f4f797fa640 1 -- 172.21.15.26:0/171321850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7400a5e0 con 0x7f4f7c1554e0 2024-04-25T13:17:27.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.620+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c15c7f0 con 0x7f4f7c1554e0 2024-04-25T13:17:27.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.620+0000 7f4f797fa640 1 -- 172.21.15.26:0/171321850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400a9d0 con 0x7f4f7c1554e0 2024-04-25T13:17:27.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.620+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c15f350 con 0x7f4f7c1554e0 2024-04-25T13:17:27.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.621+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c1531e0 con 0x7f4f7c1554e0 2024-04-25T13:17:27.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.621+0000 7f4f797fa640 1 -- 172.21.15.26:0/171321850 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f7401b070 con 0x7f4f7c1554e0 2024-04-25T13:17:27.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.622+0000 7f4f797fa640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4f6806c8f0 0x7f4f6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.622+0000 7f4f797fa640 1 -- 172.21.15.26:0/171321850 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f4f7408b530 con 0x7f4f7c1554e0 2024-04-25T13:17:27.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.622+0000 7f4f80993640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4f6806c8f0 0x7f4f6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.623+0000 7f4f80993640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4f6806c8f0 0x7f4f6806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009a10 tx=0x7f4f6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.626+0000 7f4f797fa640 1 -- 172.21.15.26:0/171321850 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f7c1531e0 con 0x7f4f7c1554e0 2024-04-25T13:17:27.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.811+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f4f7c068e40 con 0x7f4f6806c8f0 2024-04-25T13:17:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.812+0000 7f4f797fa640 1 -- 172.21.15.26:0/171321850 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f7c068e40 con 0x7f4f6806c8f0 2024-04-25T13:17:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T13:17:27.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4f6806c8f0 msgr2=0x7f4f6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4f6806c8f0 0x7f4f6806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009a10 tx=0x7f4f6c008040 comp rx=0 tx=0).stop 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c1554e0 msgr2=0x7f4f7c0c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c1554e0 0x7f4f7c0c5e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400c820 tx=0x7f4f7400cce0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 shutdown_connections 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f4f6806c8f0 0x7f4f6806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7c1554e0 0x7f4f7c0c5e40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f7c0b5450 0x7f4f7c0c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 --2- 172.21.15.26:0/171321850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f7c0b3c00 0x7f4f7c15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 >> 172.21.15.26:0/171321850 conn(0x7f4f7c074d50 msgr2=0x7f4f7c151790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 shutdown_connections 2024-04-25T13:17:27.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.814+0000 7f4f82bf7640 1 -- 172.21.15.26:0/171321850 wait complete. 2024-04-25T13:17:27.825 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T13:17:27.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.930+0000 7fbd54fc6640 1 Processor -- start 2024-04-25T13:17:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.930+0000 7fbd54fc6640 1 -- start start 2024-04-25T13:17:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd54fc6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd501554d0 0x7fbd500c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd54fc6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbd5015b160 0x7fbd5015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd54fc6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd5015be80 con 0x7fbd500c5b10 2024-04-25T13:17:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd54fc6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbd501558b0 con 0x7fbd501554d0 2024-04-25T13:17:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd54fc6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbd500c6a30 con 0x7fbd5015b160 2024-04-25T13:17:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd4e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd501554d0 0x7fbd500c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd47fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd500c5b10 0x7fbd500cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36874/0 (socket says 172.21.15.26:36874) 2024-04-25T13:17:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd47fff640 1 -- 172.21.15.26:0/4145932981 learned_addr learned my addr 172.21.15.26:0/4145932981 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd4ed9d640 1 --2- 172.21.15.26:0/4145932981 >> v2:172.21.15.169:3300/0 conn(0x7fbd5015b160 0x7fbd5015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd4e59c640 1 -- 172.21.15.26:0/4145932981 >> v2:172.21.15.169:3300/0 conn(0x7fbd5015b160 msgr2=0x7fbd5015b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd4e59c640 1 --2- 172.21.15.26:0/4145932981 >> v2:172.21.15.169:3300/0 conn(0x7fbd5015b160 0x7fbd5015b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd4e59c640 1 -- 172.21.15.26:0/4145932981 >> v1:172.21.15.26:6789/0 conn(0x7fbd500c5b10 legacy=0x7fbd500cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.931+0000 7fbd4e59c640 1 -- 172.21.15.26:0/4145932981 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd500c6100 con 0x7fbd501554d0 2024-04-25T13:17:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd4e59c640 1 --2- 172.21.15.26:0/4145932981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd501554d0 0x7fbd500c6ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd5015f7f0 tx=0x7fbd4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f6607d60996d31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd4dd9b640 1 -- 172.21.15.26:0/4145932981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40037070 con 0x7fbd501554d0 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd4dd9b640 1 -- 172.21.15.26:0/4145932981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd40032440 con 0x7fbd501554d0 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd4dd9b640 1 -- 172.21.15.26:0/4145932981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4002ae60 con 0x7fbd501554d0 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd54fc6640 1 -- 172.21.15.26:0/4145932981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd501554d0 msgr2=0x7fbd500c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd54fc6640 1 --2- 172.21.15.26:0/4145932981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd501554d0 0x7fbd500c6ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd5015f7f0 tx=0x7fbd4002a110 comp rx=0 tx=0).stop 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd54fc6640 1 -- 172.21.15.26:0/4145932981 shutdown_connections 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd54fc6640 1 --2- 172.21.15.26:0/4145932981 >> v2:172.21.15.169:3300/0 conn(0x7fbd5015b160 0x7fbd5015b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd54fc6640 1 --2- 172.21.15.26:0/4145932981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd501554d0 0x7fbd500c6ec0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.932+0000 7fbd54fc6640 1 -- 172.21.15.26:0/4145932981 >> 172.21.15.26:0/4145932981 conn(0x7fbd50068360 msgr2=0x7fbd50074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.933+0000 7fbd54fc6640 1 -- 172.21.15.26:0/4145932981 shutdown_connections 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.933+0000 7fbd54fc6640 1 -- 172.21.15.26:0/4145932981 wait complete. 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.934+0000 7fbd54fc6640 1 Processor -- start 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.934+0000 7fbd54fc6640 1 -- start start 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd500c5b10 0x7fbd500b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd501554d0 0x7fbd500b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5015b160 0x7fbd501f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbd500c66c0 con 0x7fbd5015b160 2024-04-25T13:17:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5015c160 con 0x7fbd500c5b10 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5015bb10 con 0x7fbd501554d0 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5015b160 0x7fbd501f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5015b160 0x7fbd501f44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60474/0 (socket says 172.21.15.26:60474) 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 -- 172.21.15.26:0/2703883056 learned_addr learned my addr 172.21.15.26:0/2703883056 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4e59c640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd500c5b10 0x7fbd500b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd47fff640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd501554d0 0x7fbd500b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 -- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd501554d0 msgr2=0x7fbd500b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd501554d0 0x7fbd500b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 -- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd500c5b10 msgr2=0x7fbd500b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd500c5b10 0x7fbd500b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 -- 172.21.15.26:0/2703883056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd500cf780 con 0x7fbd5015b160 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd47fff640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd501554d0 0x7fbd500b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4e59c640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd500c5b10 0x7fbd500b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd4ed9d640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5015b160 0x7fbd501f44b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd48007e60 tx=0x7fbd4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48014420 con 0x7fbd5015b160 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd48019070 con 0x7fbd5015b160 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd500cfa60 con 0x7fbd5015b160 2024-04-25T13:17:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48014820 con 0x7fbd5015b160 2024-04-25T13:17:27.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.935+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd500d0020 con 0x7fbd5015b160 2024-04-25T13:17:27.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.936+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd50068f50 con 0x7fbd5015b160 2024-04-25T13:17:27.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.937+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd480149c0 con 0x7fbd5015b160 2024-04-25T13:17:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.937+0000 7fbd46ffd640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbd3006c8f0 0x7fbd3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.937+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fbd4808c7f0 con 0x7fbd5015b160 2024-04-25T13:17:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.937+0000 7fbd46ffd640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7fbd30076400 0x7fbd300788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.937+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 --> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd48014e50 con 0x7fbd30076400 2024-04-25T13:17:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.937+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbd480912c0 con 0x7fbd5015b160 2024-04-25T13:17:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.938+0000 7fbd4e59c640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbd3006c8f0 0x7fbd3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.938+0000 7fbd47fff640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7fbd30076400 0x7fbd300788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.938+0000 7fbd47fff640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7fbd30076400 0x7fbd300788a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.938+0000 7fbd4e59c640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbd3006c8f0 0x7fbd3006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd40034000 tx=0x7fbd4002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.939+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== osd.5 v2:172.21.15.169:6800/1715640241 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd48014e50 con 0x7fbd30076400 2024-04-25T13:17:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.952+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 --> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd500cc2f0 con 0x7fbd30076400 2024-04-25T13:17:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd46ffd640 1 -- 172.21.15.26:0/2703883056 <== osd.5 v2:172.21.15.169:6800/1715640241 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd500cc2f0 con 0x7fbd30076400 2024-04-25T13:17:27.953 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:27.953 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:27.953 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7fbd30076400 msgr2=0x7fbd300788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6800/1715640241,v1:172.21.15.169:6803/1715640241] conn(0x7fbd30076400 0x7fbd300788a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbd3006c8f0 msgr2=0x7fbd3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbd3006c8f0 0x7fbd3006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd40034000 tx=0x7fbd4002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5015b160 msgr2=0x7fbd501f44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 --2- 172.21.15.26:0/2703883056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5015b160 0x7fbd501f44b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd48007e60 tx=0x7fbd4800e4b0 comp rx=0 tx=0).stop 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd4ed9d640 1 -- 172.21.15.26:0/2703883056 reap_dead start 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 shutdown_connections 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 >> 172.21.15.26:0/2703883056 conn(0x7fbd50068360 msgr2=0x7fbd50074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 shutdown_connections 2024-04-25T13:17:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:27.953+0000 7fbd54fc6640 1 -- 172.21.15.26:0/2703883056 wait complete. 2024-04-25T13:17:27.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T13:17:28.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.066+0000 7f88abd4f640 1 Processor -- start 2024-04-25T13:17:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.066+0000 7f88abd4f640 1 -- start start 2024-04-25T13:17:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.067+0000 7f88abd4f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f88a406bb90 0x7f88a415af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.067+0000 7f88abd4f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a415bef0 con 0x7f88a406bf70 2024-04-25T13:17:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.067+0000 7f88abd4f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a415b650 con 0x7f88a40c99f0 2024-04-25T13:17:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.067+0000 7f88abd4f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f88a415f510 con 0x7f88a406bb90 2024-04-25T13:17:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.067+0000 7f88a92ea640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f88a406bf70 0x7f88a415ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36888/0 (socket says 172.21.15.26:36888) 2024-04-25T13:17:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.067+0000 7f88a92ea640 1 -- 172.21.15.26:0/2341127796 learned_addr learned my addr 172.21.15.26:0/2341127796 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a9aeb640 1 --2- 172.21.15.26:0/2341127796 >> v2:172.21.15.169:3300/0 conn(0x7f88a406bb90 0x7f88a415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402249314 0 0) 0x7f88a415bef0 con 0x7f88a406bf70 2024-04-25T13:17:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f888c003520 con 0x7f88a406bf70 2024-04-25T13:17:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119534679 0 0) 0x7f88a415b650 con 0x7f88a40c99f0 2024-04-25T13:17:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a415bef0 con 0x7f88a40c99f0 2024-04-25T13:17:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3141045507 0 0) 0x7f888c003520 con 0x7f88a406bf70 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 >> v2:172.21.15.169:3300/0 conn(0x7f88a406bb90 msgr2=0x7f88a415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 --2- 172.21.15.26:0/2341127796 >> v2:172.21.15.169:3300/0 conn(0x7f88a406bb90 0x7f88a415af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 >> v1:172.21.15.169:6789/0 conn(0x7f88a40c99f0 legacy=0x7f88a4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a415b930 con 0x7f88a406bf70 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f8898001670 con 0x7f88a406bf70 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 >> v1:172.21.15.26:6789/0 conn(0x7f88a406bf70 legacy=0x7f88a415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888c003b90 0x7f888c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c004800 0x7f888c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f888c0051c0 0x7f888c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f88a415f510 con 0x7f888c0051c0 2024-04-25T13:17:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f888c00bfe0 con 0x7f888c004800 2024-04-25T13:17:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f888c00c1e0 con 0x7f888c003b90 2024-04-25T13:17:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88aa2ec640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f888c0051c0 0x7f888c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a9aeb640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888c003b90 0x7f888c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88a92ea640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c004800 0x7f888c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88aa2ec640 1 -- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888c003b90 msgr2=0x7f888c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88aa2ec640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888c003b90 0x7f888c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88aa2ec640 1 -- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c004800 msgr2=0x7f888c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88aa2ec640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c004800 0x7f888c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.068+0000 7f88aa2ec640 1 -- 172.21.15.26:0/2341127796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c003520 con 0x7f888c0051c0 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.069+0000 7f88aa2ec640 1 -- 172.21.15.26:0/2341127796 reap_dead start 2024-04-25T13:17:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.069+0000 7f88aa2ec640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f888c0051c0 0x7f888c00b9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8894001fd0 tx=0x7f888c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1d43b1a61d2816 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.069+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894001bf0 con 0x7f888c0051c0 2024-04-25T13:17:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.069+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894003b70 con 0x7f888c0051c0 2024-04-25T13:17:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.069+0000 7f88a8ae9640 1 -- 172.21.15.26:0/2341127796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940050d0 con 0x7f888c0051c0 2024-04-25T13:17:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.070+0000 7f88abd4f640 1 -- 172.21.15.26:0/2341127796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f888c0051c0 msgr2=0x7f888c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.070+0000 7f88abd4f640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f888c0051c0 0x7f888c00b9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8894001fd0 tx=0x7f888c005830 comp rx=0 tx=0).stop 2024-04-25T13:17:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.070+0000 7f88abd4f640 1 -- 172.21.15.26:0/2341127796 shutdown_connections 2024-04-25T13:17:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.070+0000 7f88abd4f640 1 --2- 172.21.15.26:0/2341127796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f888c0051c0 0x7f888c00b9c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.070+0000 7f88abd4f640 1 -- 172.21.15.26:0/2341127796 >> 172.21.15.26:0/2341127796 conn(0x7f88a4074d50 msgr2=0x7f88a4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.070+0000 7f88abd4f640 1 -- 172.21.15.26:0/2341127796 shutdown_connections 2024-04-25T13:17:28.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.070+0000 7f88abd4f640 1 -- 172.21.15.26:0/2341127796 wait complete. 2024-04-25T13:17:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.071+0000 7f88abd4f640 1 Processor -- start 2024-04-25T13:17:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.071+0000 7f88abd4f640 1 -- start start 2024-04-25T13:17:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88abd4f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c0051c0 0x7f88a415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88abd4f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a415b160 0x7f88a415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88abd4f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40cdfc0 0x7f88a41f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88abd4f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f88a415e8e0 con 0x7f88a40cdfc0 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88abd4f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88a415e600 con 0x7f888c0051c0 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88abd4f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f88a4074560 con 0x7f88a415b160 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40cdfc0 0x7f88a41f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40cdfc0 0x7f88a41f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60488/0 (socket says 172.21.15.26:60488) 2024-04-25T13:17:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 -- 172.21.15.26:0/563173710 learned_addr learned my addr 172.21.15.26:0/563173710 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88a92ea640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a415b160 0x7f88a415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88a9aeb640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c0051c0 0x7f88a415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 -- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a415b160 msgr2=0x7f88a415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a415b160 0x7f88a415d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 -- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c0051c0 msgr2=0x7f88a415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c0051c0 0x7f88a415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 -- 172.21.15.26:0/563173710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a4158f20 con 0x7f88a40cdfc0 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88aa2ec640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40cdfc0 0x7f88a41f4750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88940020c0 tx=0x7f8894001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88a27fc640 1 -- 172.21.15.26:0/563173710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894001bf0 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88a27fc640 1 -- 172.21.15.26:0/563173710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894003970 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a4159200 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.072+0000 7f88a27fc640 1 -- 172.21.15.26:0/563173710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940052e0 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.073+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a41597c0 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.073+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a4068e40 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.074+0000 7f88a27fc640 1 -- 172.21.15.26:0/563173710 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8894042030 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.074+0000 7f88a27fc640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f889006c8f0 0x7f889006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.074+0000 7f88a27fc640 1 -- 172.21.15.26:0/563173710 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f88940ab470 con 0x7f88a40cdfc0 2024-04-25T13:17:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.075+0000 7f88a9aeb640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f889006c8f0 0x7f889006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.075+0000 7f88a9aeb640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f889006c8f0 0x7f889006edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f889c009b40 tx=0x7f889c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.079+0000 7f88a27fc640 1 -- 172.21.15.26:0/563173710 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8894049060 con 0x7f88a40cdfc0 2024-04-25T13:17:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.266+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f88a41553e0 con 0x7f889006c8f0 2024-04-25T13:17:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.267+0000 7f88a27fc640 1 -- 172.21.15.26:0/563173710 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f88a41553e0 con 0x7f889006c8f0 2024-04-25T13:17:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.268+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f889006c8f0 msgr2=0x7f889006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.268+0000 7f88abd4f640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f889006c8f0 0x7f889006edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f889c009b40 tx=0x7f889c009190 comp rx=0 tx=0).stop 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.268+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40cdfc0 msgr2=0x7f88a41f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.268+0000 7f88abd4f640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40cdfc0 0x7f88a41f4750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88940020c0 tx=0x7f8894001650 comp rx=0 tx=0).stop 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 shutdown_connections 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f889006c8f0 0x7f889006edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40cdfc0 0x7f88a41f4750 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a415b160 0x7f88a415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 --2- 172.21.15.26:0/563173710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f888c0051c0 0x7f88a415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 >> 172.21.15.26:0/563173710 conn(0x7f88a4074d50 msgr2=0x7f88a41545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 shutdown_connections 2024-04-25T13:17:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.269+0000 7f88abd4f640 1 -- 172.21.15.26:0/563173710 wait complete. 2024-04-25T13:17:28.279 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T13:17:28.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:28.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.385+0000 7f27604dc640 1 Processor -- start 2024-04-25T13:17:28.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.385+0000 7f27604dc640 1 -- start start 2024-04-25T13:17:28.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.386+0000 7f27604dc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f27580c8140 0x7f275815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.386+0000 7f27604dc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2758075940 con 0x7f2758155300 2024-04-25T13:17:28.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.386+0000 7f27604dc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275815b260 con 0x7f2758154f20 2024-04-25T13:17:28.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.386+0000 7f27604dc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f275815b540 con 0x7f27580c8140 2024-04-25T13:17:28.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.386+0000 7f275da77640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2758155300 0x7f27580cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36894/0 (socket says 172.21.15.26:36894) 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.386+0000 7f275da77640 1 -- 172.21.15.26:0/3675770084 learned_addr learned my addr 172.21.15.26:0/3675770084 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275ea79640 1 --2- 172.21.15.26:0/3675770084 >> v2:172.21.15.169:3300/0 conn(0x7f27580c8140 0x7f275815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069987029 0 0) 0x7f2758075940 con 0x7f2758155300 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2740003520 con 0x7f2758155300 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1531981509 0 0) 0x7f2740003520 con 0x7f2758155300 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 >> v2:172.21.15.169:3300/0 conn(0x7f27580c8140 msgr2=0x7f275815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 --2- 172.21.15.26:0/3675770084 >> v2:172.21.15.169:3300/0 conn(0x7f27580c8140 0x7f275815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 >> v1:172.21.15.169:6789/0 conn(0x7f2758154f20 legacy=0x7f2758075230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275815b820 con 0x7f2758155300 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f274c001670 con 0x7f2758155300 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 >> v1:172.21.15.26:6789/0 conn(0x7f2758155300 legacy=0x7f27580cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2740003a00 0x7f2740003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27400051c0 0x7f274000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f275815b540 con 0x7f2740004800 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f274000c0a0 con 0x7f27400051c0 2024-04-25T13:17:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f274000c2a0 con 0x7f2740003a00 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275da77640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275ea79640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27400051c0 0x7f274000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275e278640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2740003a00 0x7f2740003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275da77640 1 -- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2740003a00 msgr2=0x7f2740003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275da77640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2740003a00 0x7f2740003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275da77640 1 -- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27400051c0 msgr2=0x7f274000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275da77640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27400051c0 0x7f274000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275da77640 1 -- 172.21.15.26:0/3675770084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2740003520 con 0x7f2740004800 2024-04-25T13:17:28.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275ea79640 1 -- 172.21.15.26:0/3675770084 reap_dead start 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.387+0000 7f275e278640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2740003a00 0x7f2740003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.388+0000 7f275da77640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2740004c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f275806d9e0 tx=0x7f2740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6386ec76d03da74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.388+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c007c40 con 0x7f2740004800 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.388+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c005af0 con 0x7f2740004800 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.388+0000 7f275d276640 1 -- 172.21.15.26:0/3675770084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c007070 con 0x7f2740004800 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.389+0000 7f27604dc640 1 -- 172.21.15.26:0/3675770084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 msgr2=0x7f2740004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.389+0000 7f27604dc640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2740004c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f275806d9e0 tx=0x7f2740005830 comp rx=0 tx=0).stop 2024-04-25T13:17:28.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.389+0000 7f27604dc640 1 -- 172.21.15.26:0/3675770084 shutdown_connections 2024-04-25T13:17:28.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.389+0000 7f27604dc640 1 --2- 172.21.15.26:0/3675770084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2740004c80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.389+0000 7f27604dc640 1 -- 172.21.15.26:0/3675770084 >> 172.21.15.26:0/3675770084 conn(0x7f275806e740 msgr2=0x7f275806feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.389+0000 7f27604dc640 1 -- 172.21.15.26:0/3675770084 shutdown_connections 2024-04-25T13:17:28.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.389+0000 7f27604dc640 1 -- 172.21.15.26:0/3675770084 wait complete. 2024-04-25T13:17:28.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.390+0000 7f27604dc640 1 Processor -- start 2024-04-25T13:17:28.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.390+0000 7f27604dc640 1 -- start start 2024-04-25T13:17:28.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f27604dc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2758155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f27604dc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f275815a7b0 0x7f27581f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f27604dc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f275815ada0 0x7f275815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f27604dc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2758075230 con 0x7f2740004800 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f27604dc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f275815bde0 con 0x7f275815ada0 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f27604dc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27580753b0 con 0x7f275815a7b0 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2758155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2758155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60502/0 (socket says 172.21.15.26:60502) 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 -- 172.21.15.26:0/1316972404 learned_addr learned my addr 172.21.15.26:0/1316972404 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:28.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275da77640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f275815a7b0 0x7f27581f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275ea79640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f275815ada0 0x7f275815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 -- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f275815a7b0 msgr2=0x7f27581f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f275815a7b0 0x7f27581f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 -- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f275815ada0 msgr2=0x7f275815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f275815ada0 0x7f275815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 -- 172.21.15.26:0/1316972404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27581568a0 con 0x7f2740004800 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.391+0000 7f275e278640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2758155940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f275000e480 tx=0x7f275000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.392+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500052e0 con 0x7f2740004800 2024-04-25T13:17:28.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.392+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2750007020 con 0x7f2740004800 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.392+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2758156000 con 0x7f2740004800 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.392+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750007210 con 0x7f2740004800 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.392+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27581565c0 con 0x7f2740004800 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.392+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2758068f50 con 0x7f2740004800 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.393+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f275001a020 con 0x7f2740004800 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.393+0000 7f2756ffd640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f274406c8f0 0x7f274406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f275008b410 con 0x7f2740004800 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f2756ffd640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7f2744076410 0x7f27440788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 --> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2744078f80 con 0x7f2744076410 2024-04-25T13:17:28.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2750092050 con 0x7f2740004800 2024-04-25T13:17:28.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f275da77640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f274406c8f0 0x7f274406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f275ea79640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7f2744076410 0x7f27440788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f275da77640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f274406c8f0 0x7f274406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f274c032000 tx=0x7f274c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.394+0000 7f275ea79640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7f2744076410 0x7f27440788b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.395+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== osd.6 v2:172.21.15.169:6824/3237270722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2744078f80 con 0x7f2744076410 2024-04-25T13:17:28.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.408+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 --> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2758151d70 con 0x7f2744076410 2024-04-25T13:17:28.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f2756ffd640 1 -- 172.21.15.26:0/1316972404 <== osd.6 v2:172.21.15.169:6824/3237270722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2758151d70 con 0x7f2744076410 2024-04-25T13:17:28.409 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:28.409 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:28.409 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:28.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7f2744076410 msgr2=0x7f27440788b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6824/3237270722,v1:172.21.15.169:6825/3237270722] conn(0x7f2744076410 0x7f27440788b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f274406c8f0 msgr2=0x7f274406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f274406c8f0 0x7f274406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f274c032000 tx=0x7f274c009030 comp rx=0 tx=0).stop 2024-04-25T13:17:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 msgr2=0x7f2758155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 --2- 172.21.15.26:0/1316972404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2740004800 0x7f2758155940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f275000e480 tx=0x7f275000e940 comp rx=0 tx=0).stop 2024-04-25T13:17:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f275ea79640 1 -- 172.21.15.26:0/1316972404 reap_dead start 2024-04-25T13:17:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 shutdown_connections 2024-04-25T13:17:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 >> 172.21.15.26:0/1316972404 conn(0x7f275806e740 msgr2=0x7f27580c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 shutdown_connections 2024-04-25T13:17:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.409+0000 7f27604dc640 1 -- 172.21.15.26:0/1316972404 wait complete. 2024-04-25T13:17:28.421 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T13:17:28.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.524+0000 7f884b031640 1 Processor -- start 2024-04-25T13:17:28.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.524+0000 7f884b031640 1 -- start start 2024-04-25T13:17:28.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f884b031640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88441554e0 0x7f884415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f884b031640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88441558c0 con 0x7f88440d08a0 2024-04-25T13:17:28.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f884b031640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884415f630 con 0x7f88440b3c00 2024-04-25T13:17:28.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f884b031640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f88440b4a80 con 0x7f88441554e0 2024-04-25T13:17:28.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f8848dcd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88441554e0 0x7f884415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f88495ce640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f88440d08a0 0x7f8844165a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36906/0 (socket says 172.21.15.26:36906) 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f88495ce640 1 -- 172.21.15.26:0/2688429584 learned_addr learned my addr 172.21.15.26:0/2688429584 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f8848dcd640 1 -- 172.21.15.26:0/2688429584 >> v1:172.21.15.169:6789/0 conn(0x7f88440b3c00 legacy=0x7f88440b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f8848dcd640 1 -- 172.21.15.26:0/2688429584 >> v1:172.21.15.26:6789/0 conn(0x7f88440d08a0 legacy=0x7f8844165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.525+0000 7f8848dcd640 1 -- 172.21.15.26:0/2688429584 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88440cb8c0 con 0x7f88441554e0 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.526+0000 7f8848dcd640 1 --2- 172.21.15.26:0/2688429584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88441554e0 0x7f884415f0f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88440b4c00 tx=0x7f883802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd93bbe4a602e06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.526+0000 7f88437fe640 1 -- 172.21.15.26:0/2688429584 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838037070 con 0x7f88441554e0 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.526+0000 7f88437fe640 1 -- 172.21.15.26:0/2688429584 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8838032440 con 0x7f88441554e0 2024-04-25T13:17:28.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.526+0000 7f88437fe640 1 -- 172.21.15.26:0/2688429584 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838032810 con 0x7f88441554e0 2024-04-25T13:17:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.527+0000 7f884b031640 1 -- 172.21.15.26:0/2688429584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88441554e0 msgr2=0x7f884415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.527+0000 7f884b031640 1 --2- 172.21.15.26:0/2688429584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88441554e0 0x7f884415f0f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88440b4c00 tx=0x7f883802a270 comp rx=0 tx=0).stop 2024-04-25T13:17:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.527+0000 7f884b031640 1 -- 172.21.15.26:0/2688429584 shutdown_connections 2024-04-25T13:17:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.527+0000 7f884b031640 1 --2- 172.21.15.26:0/2688429584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88441554e0 0x7f884415f0f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.527+0000 7f884b031640 1 -- 172.21.15.26:0/2688429584 >> 172.21.15.26:0/2688429584 conn(0x7f8844074d50 msgr2=0x7f8844075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.527+0000 7f884b031640 1 -- 172.21.15.26:0/2688429584 shutdown_connections 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.527+0000 7f884b031640 1 -- 172.21.15.26:0/2688429584 wait complete. 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.528+0000 7f884b031640 1 Processor -- start 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.528+0000 7f884b031640 1 -- start start 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f884b031640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88440b3c00 0x7f88441f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f884b031640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88440d08a0 0x7f88440c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f884b031640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88441554e0 0x7f884414b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f884b031640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f88440b4430 con 0x7f88440d08a0 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f884b031640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88440b4150 con 0x7f88440b3c00 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f884b031640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f88440b4710 con 0x7f88441554e0 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88440d08a0 0x7f88440c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88440d08a0 0x7f88440c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60510/0 (socket says 172.21.15.26:60510) 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 -- 172.21.15.26:0/3137314543 learned_addr learned my addr 172.21.15.26:0/3137314543 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8848dcd640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88440b3c00 0x7f88441f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f88495ce640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88441554e0 0x7f884414b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 -- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88441554e0 msgr2=0x7f884414b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88441554e0 0x7f884414b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 -- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88440b3c00 msgr2=0x7f88441f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88440b3c00 0x7f88441f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 -- 172.21.15.26:0/3137314543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88441e8000 con 0x7f88440d08a0 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f8843fff640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88440d08a0 0x7f88440c8320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f883000c460 tx=0x7f883000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f88417fa640 1 -- 172.21.15.26:0/3137314543 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830016020 con 0x7f88440d08a0 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f88417fa640 1 -- 172.21.15.26:0/3137314543 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8830012870 con 0x7f88440d08a0 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88441e82c0 con 0x7f88440d08a0 2024-04-25T13:17:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.529+0000 7f88417fa640 1 -- 172.21.15.26:0/3137314543 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830012c60 con 0x7f88440d08a0 2024-04-25T13:17:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.530+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88441f0ef0 con 0x7f88440d08a0 2024-04-25T13:17:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.531+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8844068e40 con 0x7f88440d08a0 2024-04-25T13:17:28.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.531+0000 7f88417fa640 1 -- 172.21.15.26:0/3137314543 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8830019020 con 0x7f88440d08a0 2024-04-25T13:17:28.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.531+0000 7f88417fa640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f882806c8f0 0x7f882806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.532+0000 7f88417fa640 1 -- 172.21.15.26:0/3137314543 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f883008bfe0 con 0x7f88440d08a0 2024-04-25T13:17:28.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.532+0000 7f8848dcd640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f882806c8f0 0x7f882806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.532+0000 7f8848dcd640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f882806c8f0 0x7f882806edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8838034000 tx=0x7f883802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.536+0000 7f88417fa640 1 -- 172.21.15.26:0/3137314543 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8830020020 con 0x7f88440d08a0 2024-04-25T13:17:28.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.721+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f884415bed0 con 0x7f882806c8f0 2024-04-25T13:17:28.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.722+0000 7f88417fa640 1 -- 172.21.15.26:0/3137314543 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f884415bed0 con 0x7f882806c8f0 2024-04-25T13:17:28.722 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T13:17:28.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.724+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f882806c8f0 msgr2=0x7f882806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.724+0000 7f884b031640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f882806c8f0 0x7f882806edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8838034000 tx=0x7f883802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.724+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88440d08a0 msgr2=0x7f88440c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.724+0000 7f884b031640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88440d08a0 0x7f88440c8320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f883000c460 tx=0x7f883000c920 comp rx=0 tx=0).stop 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.724+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 shutdown_connections 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.724+0000 7f884b031640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f882806c8f0 0x7f882806edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.724+0000 7f884b031640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88441554e0 0x7f884414b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.725+0000 7f884b031640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88440d08a0 0x7f88440c8320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.725+0000 7f884b031640 1 --2- 172.21.15.26:0/3137314543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88440b3c00 0x7f88441f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.725+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 >> 172.21.15.26:0/3137314543 conn(0x7f8844074d50 msgr2=0x7f88441534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.725+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 shutdown_connections 2024-04-25T13:17:28.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.725+0000 7f884b031640 1 -- 172.21.15.26:0/3137314543 wait complete. 2024-04-25T13:17:28.735 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T13:17:28.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.840+0000 7f3c0e4a7640 1 Processor -- start 2024-04-25T13:17:28.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.840+0000 7f3c0e4a7640 1 -- start start 2024-04-25T13:17:28.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.841+0000 7f3c0e4a7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c080c5d30 0x7f3c080c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.841+0000 7f3c0e4a7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0815bea0 con 0x7f3c080cb590 2024-04-25T13:17:28.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.841+0000 7f3c0e4a7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c080cc710 con 0x7f3c081553b0 2024-04-25T13:17:28.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.841+0000 7f3c0e4a7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3c080c6230 con 0x7f3c080c5d30 2024-04-25T13:17:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.841+0000 7f3c0ca44640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3c080cb590 0x7f3c08165a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36912/0 (socket says 172.21.15.26:36912) 2024-04-25T13:17:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.841+0000 7f3c077fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c080c5d30 0x7f3c080c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.841+0000 7f3c0ca44640 1 -- 172.21.15.26:0/4104620850 learned_addr learned my addr 172.21.15.26:0/4104620850 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.842+0000 7f3c06ffd640 1 -- 172.21.15.26:0/4104620850 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464544772 0 0) 0x7f3c0815bea0 con 0x7f3c080cb590 2024-04-25T13:17:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.842+0000 7f3c06ffd640 1 -- 172.21.15.26:0/4104620850 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf0003520 con 0x7f3c080cb590 2024-04-25T13:17:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.842+0000 7f3c077fe640 1 -- 172.21.15.26:0/4104620850 >> v1:172.21.15.169:6789/0 conn(0x7f3c081553b0 legacy=0x7f3c080d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.842+0000 7f3c077fe640 1 -- 172.21.15.26:0/4104620850 >> v1:172.21.15.26:6789/0 conn(0x7f3c080cb590 legacy=0x7f3c08165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.842+0000 7f3c077fe640 1 -- 172.21.15.26:0/4104620850 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c080cc9f0 con 0x7f3c080c5d30 2024-04-25T13:17:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.842+0000 7f3c077fe640 1 --2- 172.21.15.26:0/4104620850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c080c5d30 0x7f3c080c69a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0097a0 tx=0x7f3bfc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86f0c4303628e54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.842+0000 7f3c06ffd640 1 -- 172.21.15.26:0/4104620850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc037070 con 0x7f3c080c5d30 2024-04-25T13:17:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c06ffd640 1 -- 172.21.15.26:0/4104620850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bfc032440 con 0x7f3c080c5d30 2024-04-25T13:17:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c06ffd640 1 -- 172.21.15.26:0/4104620850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc032810 con 0x7f3c080c5d30 2024-04-25T13:17:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/4104620850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c080c5d30 msgr2=0x7f3c080c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c0e4a7640 1 --2- 172.21.15.26:0/4104620850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c080c5d30 0x7f3c080c69a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0097a0 tx=0x7f3bfc02a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/4104620850 shutdown_connections 2024-04-25T13:17:28.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c0e4a7640 1 --2- 172.21.15.26:0/4104620850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c080c5d30 0x7f3c080c69a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/4104620850 >> 172.21.15.26:0/4104620850 conn(0x7f3c08074d50 msgr2=0x7f3c08075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/4104620850 shutdown_connections 2024-04-25T13:17:28.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.843+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/4104620850 wait complete. 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.844+0000 7f3c0e4a7640 1 Processor -- start 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0e4a7640 1 -- start start 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0e4a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c080c5d30 0x7f3c0814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0e4a7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c080cb590 0x7f3c081f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0e4a7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c081553b0 0x7f3c08153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0e4a7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0815bb60 con 0x7f3c081553b0 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0e4a7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08155790 con 0x7f3c080cb590 2024-04-25T13:17:28.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0e4a7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3c080d0f20 con 0x7f3c080c5d30 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0ca44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c081553b0 0x7f3c08153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0ca44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c081553b0 0x7f3c08153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60528/0 (socket says 172.21.15.26:60528) 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.845+0000 7f3c0ca44640 1 -- 172.21.15.26:0/3834197386 learned_addr learned my addr 172.21.15.26:0/3834197386 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c077fe640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c080cb590 0x7f3c081f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c07fff640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c080c5d30 0x7f3c0814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0ca44640 1 -- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c080c5d30 msgr2=0x7f3c0814cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0ca44640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c080c5d30 0x7f3c0814cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0ca44640 1 -- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c080cb590 msgr2=0x7f3c081f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0ca44640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c080cb590 0x7f3c081f14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0ca44640 1 -- 172.21.15.26:0/3834197386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c081f1a00 con 0x7f3c081553b0 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c07fff640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c080c5d30 0x7f3c0814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0ca44640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c081553b0 0x7f3c08153740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000cb70 tx=0x7f3c0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00017070 con 0x7f3c081553b0 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0000ad40 con 0x7f3c081553b0 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00012620 con 0x7f3c081553b0 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c08155bb0 con 0x7f3c081553b0 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.846+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c081f0cc0 con 0x7f3c081553b0 2024-04-25T13:17:28.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.847+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c081f0ab0 con 0x7f3c081553b0 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c0001a070 con 0x7f3c081553b0 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c04ff9640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3bf406c920 0x7f3bf406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f3c0008bde0 con 0x7f3c081553b0 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c07fff640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3bf406c920 0x7f3bf406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c04ff9640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7f3bf4076430 0x7f3bf40788d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 --> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bf4078fa0 con 0x7f3bf4076430 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3c0008e4e0 con 0x7f3c081553b0 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.848+0000 7f3c077fe640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7f3bf4076430 0x7f3bf40788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.849+0000 7f3c07fff640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3bf406c920 0x7f3bf406ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8003eb0 tx=0x7f3bf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.849+0000 7f3c077fe640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7f3bf4076430 0x7f3bf40788d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.850+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== osd.7 v2:172.21.15.169:6801/3191394862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3bf4078fa0 con 0x7f3bf4076430 2024-04-25T13:17:28.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.863+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 --> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3c08068f50 con 0x7f3bf4076430 2024-04-25T13:17:28.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.863+0000 7f3c04ff9640 1 -- 172.21.15.26:0/3834197386 <== osd.7 v2:172.21.15.169:6801/3191394862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3c08068f50 con 0x7f3bf4076430 2024-04-25T13:17:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-25T13:17:28.863 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-25T13:17:28.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.863+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7f3bf4076430 msgr2=0x7f3bf40788d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.863+0000 7f3c0e4a7640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6801/3191394862,v1:172.21.15.169:6802/3191394862] conn(0x7f3bf4076430 0x7f3bf40788d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3bf406c920 msgr2=0x7f3bf406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f3bf406c920 0x7f3bf406ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8003eb0 tx=0x7f3bf8009040 comp rx=0 tx=0).stop 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c081553b0 msgr2=0x7f3c08153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 --2- 172.21.15.26:0/3834197386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c081553b0 0x7f3c08153740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000cb70 tx=0x7f3c0000a430 comp rx=0 tx=0).stop 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0ca44640 1 -- 172.21.15.26:0/3834197386 reap_dead start 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 shutdown_connections 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 >> 172.21.15.26:0/3834197386 conn(0x7f3c08074d50 msgr2=0x7f3c080cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 shutdown_connections 2024-04-25T13:17:28.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.864+0000 7f3c0e4a7640 1 -- 172.21.15.26:0/3834197386 wait complete. 2024-04-25T13:17:28.874 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T13:17:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.975+0000 7f2c3f1ed640 1 Processor -- start 2024-04-25T13:17:28.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.975+0000 7f2c3f1ed640 1 -- start start 2024-04-25T13:17:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c3f1ed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 0x7f2c3815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c3f1ed640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c381558c0 con 0x7f2c380b3c00 2024-04-25T13:17:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c3f1ed640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c3815f630 con 0x7f2c380d08a0 2024-04-25T13:17:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c3f1ed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c380b4a80 con 0x7f2c381554e0 2024-04-25T13:17:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c37fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2c380b3c00 0x7f2c380b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36926/0 (socket says 172.21.15.26:36926) 2024-04-25T13:17:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c37fff640 1 -- 172.21.15.26:0/2032814066 learned_addr learned my addr 172.21.15.26:0/2032814066 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 0x7f2c3815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.976+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213312665 0 0) 0x7f2c20001110 con 0x7f2c380b3c00 2024-04-25T13:17:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c24003520 con 0x7f2c380b3c00 2024-04-25T13:17:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378769607 0 0) 0x7f2c3815f630 con 0x7f2c380d08a0 2024-04-25T13:17:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c20001110 con 0x7f2c380d08a0 2024-04-25T13:17:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1212856168 0 0) 0x7f2c24003520 con 0x7f2c380b3c00 2024-04-25T13:17:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 msgr2=0x7f2c3815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 0x7f2c3815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 >> v1:172.21.15.169:6789/0 conn(0x7f2c380d08a0 legacy=0x7f2c38165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c380cb8c0 con 0x7f2c380b3c00 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7f2c20001840 con 0x7f2c380b3c00 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 >> v1:172.21.15.26:6789/0 conn(0x7f2c380b3c00 legacy=0x7f2c380b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c24003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c24004800 0x7f2c24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 0x7f2c240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380b4a80 con 0x7f2c24003b70 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2400ba70 con 0x7f2c24004800 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2400bc70 con 0x7f2c381554e0 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c24003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c37fff640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c24004800 0x7f2c24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3d78a640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 0x7f2c240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3cf89640 1 -- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 msgr2=0x7f2c240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 0x7f2c240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3cf89640 1 -- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c24004800 msgr2=0x7f2c24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c24004800 0x7f2c24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3cf89640 1 -- 172.21.15.26:0/2032814066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c24003520 con 0x7f2c24003b70 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.977+0000 7f2c3d78a640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c381554e0 0x7f2c240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.978+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c24003f70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009fc0 tx=0x7f2c24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aae6972f66927b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.978+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30009c10 con 0x7f2c24003b70 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.978+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c30036070 con 0x7f2c24003b70 2024-04-25T13:17:28.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.978+0000 7f2c377fe640 1 -- 172.21.15.26:0/2032814066 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30031880 con 0x7f2c24003b70 2024-04-25T13:17:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.979+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/2032814066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 msgr2=0x7f2c24003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.979+0000 7f2c3f1ed640 1 --2- 172.21.15.26:0/2032814066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c24003f70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009fc0 tx=0x7f2c24005830 comp rx=0 tx=0).stop 2024-04-25T13:17:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.979+0000 7f2c3d78a640 1 -- 172.21.15.26:0/2032814066 reap_dead start 2024-04-25T13:17:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.979+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/2032814066 shutdown_connections 2024-04-25T13:17:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.979+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/2032814066 >> 172.21.15.26:0/2032814066 conn(0x7f2c38074d50 msgr2=0x7f2c38075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.979+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/2032814066 shutdown_connections 2024-04-25T13:17:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.979+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/2032814066 wait complete. 2024-04-25T13:17:28.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.980+0000 7f2c3f1ed640 1 Processor -- start 2024-04-25T13:17:28.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.980+0000 7f2c3f1ed640 1 -- start start 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3f1ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c3814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3f1ed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c38148aa0 0x7f2c38155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3f1ed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c38149600 0x7f2c38156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3f1ed640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380b4430 con 0x7f2c24003b70 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3f1ed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380b4150 con 0x7f2c38149600 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3f1ed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c380b4710 con 0x7f2c38148aa0 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c3814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c3814e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60554/0 (socket says 172.21.15.26:60554) 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 -- 172.21.15.26:0/3069280743 learned_addr learned my addr 172.21.15.26:0/3069280743 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c37fff640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c38148aa0 0x7f2c38155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3d78a640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c38149600 0x7f2c38156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 -- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c38148aa0 msgr2=0x7f2c38155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c38148aa0 0x7f2c38155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 -- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c38149600 msgr2=0x7f2c38156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c38149600 0x7f2c38156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 -- 172.21.15.26:0/3069280743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c381f55c0 con 0x7f2c24003b70 2024-04-25T13:17:28.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c3cf89640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c3814e820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2c30033040 tx=0x7f2c30009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.981+0000 7f2c357fa640 1 -- 172.21.15.26:0/3069280743 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30009c10 con 0x7f2c24003b70 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.982+0000 7f2c357fa640 1 -- 172.21.15.26:0/3069280743 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c30031e50 con 0x7f2c24003b70 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.982+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c380ca690 con 0x7f2c24003b70 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.982+0000 7f2c357fa640 1 -- 172.21.15.26:0/3069280743 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30003bd0 con 0x7f2c24003b70 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.982+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c380cac50 con 0x7f2c24003b70 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.983+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c38068e40 con 0x7f2c24003b70 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.983+0000 7f2c357fa640 1 -- 172.21.15.26:0/3069280743 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c30005d10 con 0x7f2c24003b70 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.984+0000 7f2c357fa640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2c1806c8f0 0x7f2c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:28.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.984+0000 7f2c357fa640 1 -- 172.21.15.26:0/3069280743 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f2c300ad150 con 0x7f2c24003b70 2024-04-25T13:17:28.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.984+0000 7f2c37fff640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2c1806c8f0 0x7f2c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:28.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.984+0000 7f2c37fff640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2c1806c8f0 0x7f2c1806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c200019b0 tx=0x7f2c20007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:28.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:28.988+0000 7f2c357fa640 1 -- 172.21.15.26:0/3069280743 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c3007b140 con 0x7f2c24003b70 2024-04-25T13:17:29.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.174+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2c380ca440 con 0x7f2c1806c8f0 2024-04-25T13:17:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.174+0000 7f2c357fa640 1 -- 172.21.15.26:0/3069280743 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c380ca440 con 0x7f2c1806c8f0 2024-04-25T13:17:29.174 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2c1806c8f0 msgr2=0x7f2c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2c1806c8f0 0x7f2c1806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c200019b0 tx=0x7f2c20007040 comp rx=0 tx=0).stop 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 msgr2=0x7f2c3814e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c3814e820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2c30033040 tx=0x7f2c30009750 comp rx=0 tx=0).stop 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 shutdown_connections 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f2c1806c8f0 0x7f2c1806edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c38149600 0x7f2c38156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c38148aa0 0x7f2c38155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.176+0000 7f2c3f1ed640 1 --2- 172.21.15.26:0/3069280743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c24003b70 0x7f2c3814e820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.177+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 >> 172.21.15.26:0/3069280743 conn(0x7f2c38074d50 msgr2=0x7f2c38150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:29.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.177+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 shutdown_connections 2024-04-25T13:17:29.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.177+0000 7f2c3f1ed640 1 -- 172.21.15.26:0/3069280743 wait complete. 2024-04-25T13:17:29.187 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.290+0000 7fb42e4e8640 1 Processor -- start 2024-04-25T13:17:29.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.290+0000 7fb42e4e8640 1 -- start start 2024-04-25T13:17:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb42e4e8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb428152f70 0x7fb4280c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb42e4e8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb428158fe0 con 0x7fb4280c8870 2024-04-25T13:17:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb42e4e8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4281592c0 con 0x7fb42815cbd0 2024-04-25T13:17:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb42e4e8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb4281595a0 con 0x7fb428152f70 2024-04-25T13:17:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb427fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb428152f70 0x7fb4280c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb4277fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb4280c8870 0x7fb42815c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36938/0 (socket says 172.21.15.26:36938) 2024-04-25T13:17:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb4277fe640 1 -- 172.21.15.26:0/2355027710 learned_addr learned my addr 172.21.15.26:0/2355027710 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb427fff640 1 -- 172.21.15.26:0/2355027710 >> v1:172.21.15.169:6789/0 conn(0x7fb42815cbd0 legacy=0x7fb428073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb427fff640 1 -- 172.21.15.26:0/2355027710 >> v1:172.21.15.26:6789/0 conn(0x7fb4280c8870 legacy=0x7fb42815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.291+0000 7fb427fff640 1 -- 172.21.15.26:0/2355027710 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb428159880 con 0x7fb428152f70 2024-04-25T13:17:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.292+0000 7fb427fff640 1 --2- 172.21.15.26:0/2355027710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb4280c5b50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4180097a0 tx=0x7fb41802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234579f23f7cbd6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.292+0000 7fb426ffd640 1 -- 172.21.15.26:0/2355027710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418037070 con 0x7fb428152f70 2024-04-25T13:17:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.292+0000 7fb426ffd640 1 -- 172.21.15.26:0/2355027710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb418032440 con 0x7fb428152f70 2024-04-25T13:17:29.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.292+0000 7fb426ffd640 1 -- 172.21.15.26:0/2355027710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418032810 con 0x7fb428152f70 2024-04-25T13:17:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.293+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2355027710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 msgr2=0x7fb4280c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.293+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2355027710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb4280c5b50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4180097a0 tx=0x7fb41802a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.293+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2355027710 shutdown_connections 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.293+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2355027710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb4280c5b50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.293+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2355027710 >> 172.21.15.26:0/2355027710 conn(0x7fb428074d50 msgr2=0x7fb428075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.293+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2355027710 shutdown_connections 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.293+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2355027710 wait complete. 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.294+0000 7fb42e4e8640 1 Processor -- start 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.294+0000 7fb42e4e8640 1 -- start start 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb42e4e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4280c8870 0x7fb4281f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb42e4e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb428156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb42e4e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb42815cbd0 0x7fb4280ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb42e4e8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281534d0 con 0x7fb428152f70 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb42e4e8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb428153350 con 0x7fb4280c8870 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb42e4e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb428074140 con 0x7fb42815cbd0 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb428156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb428156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60560/0 (socket says 172.21.15.26:60560) 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 -- 172.21.15.26:0/2322655244 learned_addr learned my addr 172.21.15.26:0/2322655244 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb427fff640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4280c8870 0x7fb4281f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb42ca85640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb42815cbd0 0x7fb4280ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 -- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb42815cbd0 msgr2=0x7fb4280ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb42815cbd0 0x7fb4280ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 -- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4280c8870 msgr2=0x7fb4281f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4280c8870 0x7fb4281f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 -- 172.21.15.26:0/2322655244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4281f3160 con 0x7fb428152f70 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.295+0000 7fb4277fe640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb428156c00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c440 tx=0x7fb410001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.296+0000 7fb424ff9640 1 -- 172.21.15.26:0/2322655244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410017070 con 0x7fb428152f70 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.296+0000 7fb424ff9640 1 -- 172.21.15.26:0/2322655244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410005ce0 con 0x7fb428152f70 2024-04-25T13:17:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.296+0000 7fb424ff9640 1 -- 172.21.15.26:0/2322655244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4100072f0 con 0x7fb428152f70 2024-04-25T13:17:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.296+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4281eecf0 con 0x7fb428152f70 2024-04-25T13:17:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.296+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4280cc950 con 0x7fb428152f70 2024-04-25T13:17:29.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.297+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb428068e40 con 0x7fb428152f70 2024-04-25T13:17:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.297+0000 7fb424ff9640 1 -- 172.21.15.26:0/2322655244 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb41001a070 con 0x7fb428152f70 2024-04-25T13:17:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.297+0000 7fb424ff9640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb40806c8f0 0x7fb40806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.298+0000 7fb424ff9640 1 -- 172.21.15.26:0/2322655244 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb41008b3e0 con 0x7fb428152f70 2024-04-25T13:17:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.298+0000 7fb427fff640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb40806c8f0 0x7fb40806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.298+0000 7fb427fff640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb40806c8f0 0x7fb40806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb418034000 tx=0x7fb41802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.302+0000 7fb424ff9640 1 -- 172.21.15.26:0/2322655244 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb410058c70 con 0x7fb428152f70 2024-04-25T13:17:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.486+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4280ccc30 con 0x7fb40806c8f0 2024-04-25T13:17:29.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.495+0000 7fb424ff9640 1 -- 172.21.15.26:0/2322655244 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331999 (secure 0 0 0) 0x7fb4280ccc30 con 0x7fb40806c8f0 2024-04-25T13:17:29.498 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:29.499 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:17:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb40806c8f0 msgr2=0x7fb40806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb40806c8f0 0x7fb40806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb418034000 tx=0x7fb41802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 msgr2=0x7fb428156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb428156c00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c440 tx=0x7fb410001e70 comp rx=0 tx=0).stop 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 shutdown_connections 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fb40806c8f0 0x7fb40806edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb42815cbd0 0x7fb4280ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb428152f70 0x7fb428156c00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 --2- 172.21.15.26:0/2322655244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4280c8870 0x7fb4281f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 >> 172.21.15.26:0/2322655244 conn(0x7fb428074d50 msgr2=0x7fb428151ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 shutdown_connections 2024-04-25T13:17:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:29.498+0000 7fb42e4e8640 1 -- 172.21.15.26:0/2322655244 wait complete. 2024-04-25T13:17:29.508 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-25T13:17:29.181584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":564,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388819+0000","last_change":"2024-04-25T13:16:09.228050+0000","last_active":"2024-04-25T13:17:02.388819+0000","last_peered":"2024-04-25T13:17:02.388819+0000","last_clean":"2024-04-25T13:17:02.388819+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:17:02.388819+0000","last_undegraded":"2024-04-25T13:17:02.388819+0000","last_fullsized":"2024-04-25T13:17:02.388819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357827+0000","last_change":"2024-04-25T13:16:10.235950+0000","last_active":"2024-04-25T13:16:50.357827+0000","last_peered":"2024-04-25T13:16:50.357827+0000","last_clean":"2024-04-25T13:16:50.357827+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:16:50.357827+0000","last_undegraded":"2024-04-25T13:16:50.357827+0000","last_fullsized":"2024-04-25T13:16:50.357827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.659755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355169+0000","last_change":"2024-04-25T13:16:14.256905+0000","last_active":"2024-04-25T13:16:50.355169+0000","last_peered":"2024-04-25T13:16:50.355169+0000","last_clean":"2024-04-25T13:16:50.355169+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:16:50.355169+0000","last_undegraded":"2024-04-25T13:16:50.355169+0000","last_fullsized":"2024-04-25T13:16:50.355169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:20.756082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.360171+0000","last_change":"2024-04-25T13:16:09.227299+0000","last_active":"2024-04-25T13:16:50.360171+0000","last_peered":"2024-04-25T13:16:50.360171+0000","last_clean":"2024-04-25T13:16:50.360171+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:16:50.360171+0000","last_undegraded":"2024-04-25T13:16:50.360171+0000","last_fullsized":"2024-04-25T13:16:50.360171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:14.031274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363590+0000","last_change":"2024-04-25T13:16:10.237733+0000","last_active":"2024-04-25T13:16:50.363590+0000","last_peered":"2024-04-25T13:16:50.363590+0000","last_clean":"2024-04-25T13:16:50.363590+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:16:50.363590+0000","last_undegraded":"2024-04-25T13:16:50.363590+0000","last_fullsized":"2024-04-25T13:16:50.363590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362029+0000","last_change":"2024-04-25T13:16:50.362029+0000","last_active":"2024-04-25T13:16:50.362029+0000","last_peered":"2024-04-25T13:16:50.362029+0000","last_clean":"2024-04-25T13:16:50.362029+0000","last_became_active":"2024-04-25T13:16:50.361435+0000","last_became_peered":"2024-04-25T13:16:50.361435+0000","last_unstale":"2024-04-25T13:16:50.362029+0000","last_undegraded":"2024-04-25T13:16:50.362029+0000","last_fullsized":"2024-04-25T13:16:50.362029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:46.962760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391259+0000","last_change":"2024-04-25T13:16:09.235533+0000","last_active":"2024-04-25T13:17:02.391259+0000","last_peered":"2024-04-25T13:17:02.391259+0000","last_clean":"2024-04-25T13:17:02.391259+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:17:02.391259+0000","last_undegraded":"2024-04-25T13:17:02.391259+0000","last_fullsized":"2024-04-25T13:17:02.391259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:02.522659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367333+0000","last_change":"2024-04-25T13:16:10.241487+0000","last_active":"2024-04-25T13:16:50.367333+0000","last_peered":"2024-04-25T13:16:50.367333+0000","last_clean":"2024-04-25T13:16:50.367333+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:16:50.367333+0000","last_undegraded":"2024-04-25T13:16:50.367333+0000","last_fullsized":"2024-04-25T13:16:50.367333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:17.877358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355175+0000","last_change":"2024-04-25T13:16:14.257584+0000","last_active":"2024-04-25T13:16:50.355175+0000","last_peered":"2024-04-25T13:16:50.355175+0000","last_clean":"2024-04-25T13:16:50.355175+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:16:50.355175+0000","last_undegraded":"2024-04-25T13:16:50.355175+0000","last_fullsized":"2024-04-25T13:16:50.355175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.434026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391164+0000","last_change":"2024-04-25T13:16:09.231497+0000","last_active":"2024-04-25T13:17:02.391164+0000","last_peered":"2024-04-25T13:17:02.391164+0000","last_clean":"2024-04-25T13:17:02.391164+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:17:02.391164+0000","last_undegraded":"2024-04-25T13:17:02.391164+0000","last_fullsized":"2024-04-25T13:17:02.391164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:45.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368422+0000","last_change":"2024-04-25T13:16:10.242155+0000","last_active":"2024-04-25T13:16:50.368422+0000","last_peered":"2024-04-25T13:16:50.368422+0000","last_clean":"2024-04-25T13:16:50.368422+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:16:50.368422+0000","last_undegraded":"2024-04-25T13:16:50.368422+0000","last_fullsized":"2024-04-25T13:16:50.368422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:54.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354866+0000","last_change":"2024-04-25T13:16:14.260019+0000","last_active":"2024-04-25T13:16:50.354866+0000","last_peered":"2024-04-25T13:16:50.354866+0000","last_clean":"2024-04-25T13:16:50.354866+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:16:50.354866+0000","last_undegraded":"2024-04-25T13:16:50.354866+0000","last_fullsized":"2024-04-25T13:16:50.354866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:54.341003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356746+0000","last_change":"2024-04-25T13:16:10.236261+0000","last_active":"2024-04-25T13:16:50.356746+0000","last_peered":"2024-04-25T13:16:50.356746+0000","last_clean":"2024-04-25T13:16:50.356746+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:16:50.356746+0000","last_undegraded":"2024-04-25T13:16:50.356746+0000","last_fullsized":"2024-04-25T13:16:50.356746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:13.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355245+0000","last_change":"2024-04-25T13:16:09.233393+0000","last_active":"2024-04-25T13:16:50.355245+0000","last_peered":"2024-04-25T13:16:50.355245+0000","last_clean":"2024-04-25T13:16:50.355245+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:16:50.355245+0000","last_undegraded":"2024-04-25T13:16:50.355245+0000","last_fullsized":"2024-04-25T13:16:50.355245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:52.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355580+0000","last_change":"2024-04-25T13:16:14.256306+0000","last_active":"2024-04-25T13:16:50.355580+0000","last_peered":"2024-04-25T13:16:50.355580+0000","last_clean":"2024-04-25T13:16:50.355580+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:16:50.355580+0000","last_undegraded":"2024-04-25T13:16:50.355580+0000","last_fullsized":"2024-04-25T13:16:50.355580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:01.174239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.359349+0000","last_change":"2024-04-25T13:16:10.229248+0000","last_active":"2024-04-25T13:16:50.359349+0000","last_peered":"2024-04-25T13:16:50.359349+0000","last_clean":"2024-04-25T13:16:50.359349+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:16:50.359349+0000","last_undegraded":"2024-04-25T13:16:50.359349+0000","last_fullsized":"2024-04-25T13:16:50.359349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.198324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377123+0000","last_change":"2024-04-25T13:16:09.225683+0000","last_active":"2024-04-25T13:16:56.377123+0000","last_peered":"2024-04-25T13:16:56.377123+0000","last_clean":"2024-04-25T13:16:56.377123+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:16:56.377123+0000","last_undegraded":"2024-04-25T13:16:56.377123+0000","last_fullsized":"2024-04-25T13:16:56.377123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:06.658268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.370263+0000","last_change":"2024-04-25T13:16:50.370263+0000","last_active":"2024-04-25T13:16:50.370263+0000","last_peered":"2024-04-25T13:16:50.370263+0000","last_clean":"2024-04-25T13:16:50.370263+0000","last_became_active":"2024-04-25T13:16:50.369812+0000","last_became_peered":"2024-04-25T13:16:50.369812+0000","last_unstale":"2024-04-25T13:16:50.370263+0000","last_undegraded":"2024-04-25T13:16:50.370263+0000","last_fullsized":"2024-04-25T13:16:50.370263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:03.168762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356486+0000","last_change":"2024-04-25T13:16:10.230936+0000","last_active":"2024-04-25T13:16:50.356486+0000","last_peered":"2024-04-25T13:16:50.356486+0000","last_clean":"2024-04-25T13:16:50.356486+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:16:50.356486+0000","last_undegraded":"2024-04-25T13:16:50.356486+0000","last_fullsized":"2024-04-25T13:16:50.356486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:53.512633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.986821+0000","last_change":"2024-04-25T13:16:09.226404+0000","last_active":"2024-04-25T13:17:02.986821+0000","last_peered":"2024-04-25T13:17:02.986821+0000","last_clean":"2024-04-25T13:17:02.986821+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:17:02.986821+0000","last_undegraded":"2024-04-25T13:17:02.986821+0000","last_fullsized":"2024-04-25T13:17:02.986821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:08.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363856+0000","last_change":"2024-04-25T13:16:14.268846+0000","last_active":"2024-04-25T13:16:50.363856+0000","last_peered":"2024-04-25T13:16:50.363856+0000","last_clean":"2024-04-25T13:16:50.363856+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:16:50.363856+0000","last_undegraded":"2024-04-25T13:16:50.363856+0000","last_fullsized":"2024-04-25T13:16:50.363856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:03.021121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355128+0000","last_change":"2024-04-25T13:16:10.221343+0000","last_active":"2024-04-25T13:16:50.355128+0000","last_peered":"2024-04-25T13:16:50.355128+0000","last_clean":"2024-04-25T13:16:50.355128+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:16:50.355128+0000","last_undegraded":"2024-04-25T13:16:50.355128+0000","last_fullsized":"2024-04-25T13:16:50.355128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:23.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354149+0000","last_change":"2024-04-25T13:16:09.231622+0000","last_active":"2024-04-25T13:16:50.354149+0000","last_peered":"2024-04-25T13:16:50.354149+0000","last_clean":"2024-04-25T13:16:50.354149+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:16:50.354149+0000","last_undegraded":"2024-04-25T13:16:50.354149+0000","last_fullsized":"2024-04-25T13:16:50.354149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:17.785859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355790+0000","last_change":"2024-04-25T13:16:14.260133+0000","last_active":"2024-04-25T13:16:50.355790+0000","last_peered":"2024-04-25T13:16:50.355790+0000","last_clean":"2024-04-25T13:16:50.355790+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:16:50.355790+0000","last_undegraded":"2024-04-25T13:16:50.355790+0000","last_fullsized":"2024-04-25T13:16:50.355790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:23.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362994+0000","last_change":"2024-04-25T13:16:10.228682+0000","last_active":"2024-04-25T13:16:50.362994+0000","last_peered":"2024-04-25T13:16:50.362994+0000","last_clean":"2024-04-25T13:16:50.362994+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:16:50.362994+0000","last_undegraded":"2024-04-25T13:16:50.362994+0000","last_fullsized":"2024-04-25T13:16:50.362994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.390990+0000","last_change":"2024-04-25T13:16:09.236054+0000","last_active":"2024-04-25T13:17:02.390990+0000","last_peered":"2024-04-25T13:17:02.390990+0000","last_clean":"2024-04-25T13:17:02.390990+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:17:02.390990+0000","last_undegraded":"2024-04-25T13:17:02.390990+0000","last_fullsized":"2024-04-25T13:17:02.390990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:47.399535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354770+0000","last_change":"2024-04-25T13:16:14.255902+0000","last_active":"2024-04-25T13:16:50.354770+0000","last_peered":"2024-04-25T13:16:50.354770+0000","last_clean":"2024-04-25T13:16:50.354770+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:16:50.354770+0000","last_undegraded":"2024-04-25T13:16:50.354770+0000","last_fullsized":"2024-04-25T13:16:50.354770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:13.698235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357314+0000","last_change":"2024-04-25T13:16:10.236688+0000","last_active":"2024-04-25T13:16:50.357314+0000","last_peered":"2024-04-25T13:16:50.357314+0000","last_clean":"2024-04-25T13:16:50.357314+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:16:50.357314+0000","last_undegraded":"2024-04-25T13:16:50.357314+0000","last_fullsized":"2024-04-25T13:16:50.357314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:40.262859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377315+0000","last_change":"2024-04-25T13:16:09.233901+0000","last_active":"2024-04-25T13:16:56.377315+0000","last_peered":"2024-04-25T13:16:56.377315+0000","last_clean":"2024-04-25T13:16:56.377315+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:16:56.377315+0000","last_undegraded":"2024-04-25T13:16:56.377315+0000","last_fullsized":"2024-04-25T13:16:56.377315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:37.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355824+0000","last_change":"2024-04-25T13:16:14.264507+0000","last_active":"2024-04-25T13:16:50.355824+0000","last_peered":"2024-04-25T13:16:50.355824+0000","last_clean":"2024-04-25T13:16:50.355824+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:16:50.355824+0000","last_undegraded":"2024-04-25T13:16:50.355824+0000","last_fullsized":"2024-04-25T13:16:50.355824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:13.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364127+0000","last_change":"2024-04-25T13:16:10.226658+0000","last_active":"2024-04-25T13:16:50.364127+0000","last_peered":"2024-04-25T13:16:50.364127+0000","last_clean":"2024-04-25T13:16:50.364127+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:16:50.364127+0000","last_undegraded":"2024-04-25T13:16:50.364127+0000","last_fullsized":"2024-04-25T13:16:50.364127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:29.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377941+0000","last_change":"2024-04-25T13:16:09.234475+0000","last_active":"2024-04-25T13:16:56.377941+0000","last_peered":"2024-04-25T13:16:56.377941+0000","last_clean":"2024-04-25T13:16:56.377941+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:16:56.377941+0000","last_undegraded":"2024-04-25T13:16:56.377941+0000","last_fullsized":"2024-04-25T13:16:56.377941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:19.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363915+0000","last_change":"2024-04-25T13:16:14.259942+0000","last_active":"2024-04-25T13:16:50.363915+0000","last_peered":"2024-04-25T13:16:50.363915+0000","last_clean":"2024-04-25T13:16:50.363915+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:16:50.363915+0000","last_undegraded":"2024-04-25T13:16:50.363915+0000","last_fullsized":"2024-04-25T13:16:50.363915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368468+0000","last_change":"2024-04-25T13:16:10.238550+0000","last_active":"2024-04-25T13:16:50.368468+0000","last_peered":"2024-04-25T13:16:50.368468+0000","last_clean":"2024-04-25T13:16:50.368468+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.368468+0000","last_undegraded":"2024-04-25T13:16:50.368468+0000","last_fullsized":"2024-04-25T13:16:50.368468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:43.498149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364301+0000","last_change":"2024-04-25T13:16:09.229132+0000","last_active":"2024-04-25T13:16:50.364301+0000","last_peered":"2024-04-25T13:16:50.364301+0000","last_clean":"2024-04-25T13:16:50.364301+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:16:50.364301+0000","last_undegraded":"2024-04-25T13:16:50.364301+0000","last_fullsized":"2024-04-25T13:16:50.364301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:51.023834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364120+0000","last_change":"2024-04-25T13:16:14.256020+0000","last_active":"2024-04-25T13:16:50.364120+0000","last_peered":"2024-04-25T13:16:50.364120+0000","last_clean":"2024-04-25T13:16:50.364120+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:16:50.364120+0000","last_undegraded":"2024-04-25T13:16:50.364120+0000","last_fullsized":"2024-04-25T13:16:50.364120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.300724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355530+0000","last_change":"2024-04-25T13:16:10.232204+0000","last_active":"2024-04-25T13:16:50.355530+0000","last_peered":"2024-04-25T13:16:50.355530+0000","last_clean":"2024-04-25T13:16:50.355530+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:16:50.355530+0000","last_undegraded":"2024-04-25T13:16:50.355530+0000","last_fullsized":"2024-04-25T13:16:50.355530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:57.599476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388455+0000","last_change":"2024-04-25T13:16:09.231256+0000","last_active":"2024-04-25T13:17:02.388455+0000","last_peered":"2024-04-25T13:17:02.388455+0000","last_clean":"2024-04-25T13:17:02.388455+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:17:02.388455+0000","last_undegraded":"2024-04-25T13:17:02.388455+0000","last_fullsized":"2024-04-25T13:17:02.388455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.615041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363511+0000","last_change":"2024-04-25T13:16:14.267288+0000","last_active":"2024-04-25T13:16:50.363511+0000","last_peered":"2024-04-25T13:16:50.363511+0000","last_clean":"2024-04-25T13:16:50.363511+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:16:50.363511+0000","last_undegraded":"2024-04-25T13:16:50.363511+0000","last_fullsized":"2024-04-25T13:16:50.363511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364360+0000","last_change":"2024-04-25T13:16:10.224545+0000","last_active":"2024-04-25T13:16:50.364360+0000","last_peered":"2024-04-25T13:16:50.364360+0000","last_clean":"2024-04-25T13:16:50.364360+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:16:50.364360+0000","last_undegraded":"2024-04-25T13:16:50.364360+0000","last_fullsized":"2024-04-25T13:16:50.364360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:05.318639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.386945+0000","last_change":"2024-04-25T13:16:09.222045+0000","last_active":"2024-04-25T13:17:02.386945+0000","last_peered":"2024-04-25T13:17:02.386945+0000","last_clean":"2024-04-25T13:17:02.386945+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:17:02.386945+0000","last_undegraded":"2024-04-25T13:17:02.386945+0000","last_fullsized":"2024-04-25T13:17:02.386945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:35.610266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364118+0000","last_change":"2024-04-25T13:16:14.268287+0000","last_active":"2024-04-25T13:16:50.364118+0000","last_peered":"2024-04-25T13:16:50.364118+0000","last_clean":"2024-04-25T13:16:50.364118+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:16:50.364118+0000","last_undegraded":"2024-04-25T13:16:50.364118+0000","last_fullsized":"2024-04-25T13:16:50.364118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:15.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364269+0000","last_change":"2024-04-25T13:16:10.225812+0000","last_active":"2024-04-25T13:16:50.364269+0000","last_peered":"2024-04-25T13:16:50.364269+0000","last_clean":"2024-04-25T13:16:50.364269+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:16:50.364269+0000","last_undegraded":"2024-04-25T13:16:50.364269+0000","last_fullsized":"2024-04-25T13:16:50.364269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365277+0000","last_change":"2024-04-25T13:16:09.232184+0000","last_active":"2024-04-25T13:16:50.365277+0000","last_peered":"2024-04-25T13:16:50.365277+0000","last_clean":"2024-04-25T13:16:50.365277+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:16:50.365277+0000","last_undegraded":"2024-04-25T13:16:50.365277+0000","last_fullsized":"2024-04-25T13:16:50.365277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:32.504692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362756+0000","last_change":"2024-04-25T13:16:14.258508+0000","last_active":"2024-04-25T13:16:50.362756+0000","last_peered":"2024-04-25T13:16:50.362756+0000","last_clean":"2024-04-25T13:16:50.362756+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:16:50.362756+0000","last_undegraded":"2024-04-25T13:16:50.362756+0000","last_fullsized":"2024-04-25T13:16:50.362756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.373995+0000","last_change":"2024-04-25T13:16:50.373995+0000","last_active":"2024-04-25T13:16:50.373995+0000","last_peered":"2024-04-25T13:16:50.373995+0000","last_clean":"2024-04-25T13:16:50.373995+0000","last_became_active":"2024-04-25T13:16:50.373669+0000","last_became_peered":"2024-04-25T13:16:50.373669+0000","last_unstale":"2024-04-25T13:16:50.373995+0000","last_undegraded":"2024-04-25T13:16:50.373995+0000","last_fullsized":"2024-04-25T13:16:50.373995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:28.967657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376971+0000","last_change":"2024-04-25T13:16:09.228710+0000","last_active":"2024-04-25T13:16:56.376971+0000","last_peered":"2024-04-25T13:16:56.376971+0000","last_clean":"2024-04-25T13:16:56.376971+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:16:56.376971+0000","last_undegraded":"2024-04-25T13:16:56.376971+0000","last_fullsized":"2024-04-25T13:16:56.376971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:45.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354328+0000","last_change":"2024-04-25T13:15:57.412629+0000","last_active":"2024-04-25T13:16:50.354328+0000","last_peered":"2024-04-25T13:16:50.354328+0000","last_clean":"2024-04-25T13:16:50.354328+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:16:50.354328+0000","last_undegraded":"2024-04-25T13:16:50.354328+0000","last_fullsized":"2024-04-25T13:16:50.354328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:56.163882+0000","last_clean_scrub_stamp":"2024-04-25T13:15:56.163882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:04.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357049+0000","last_change":"2024-04-25T13:16:14.257978+0000","last_active":"2024-04-25T13:16:50.357049+0000","last_peered":"2024-04-25T13:16:50.357049+0000","last_clean":"2024-04-25T13:16:50.357049+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:16:50.357049+0000","last_undegraded":"2024-04-25T13:16:50.357049+0000","last_fullsized":"2024-04-25T13:16:50.357049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:11.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365712+0000","last_change":"2024-04-25T13:16:50.365712+0000","last_active":"2024-04-25T13:16:50.365712+0000","last_peered":"2024-04-25T13:16:50.365712+0000","last_clean":"2024-04-25T13:16:50.365712+0000","last_became_active":"2024-04-25T13:16:50.365465+0000","last_became_peered":"2024-04-25T13:16:50.365465+0000","last_unstale":"2024-04-25T13:16:50.365712+0000","last_undegraded":"2024-04-25T13:16:50.365712+0000","last_fullsized":"2024-04-25T13:16:50.365712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:02.718759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.778414+0000","last_change":"2024-04-25T13:16:09.225612+0000","last_active":"2024-04-25T13:17:10.778414+0000","last_peered":"2024-04-25T13:17:10.778414+0000","last_clean":"2024-04-25T13:17:10.778414+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:17:10.778414+0000","last_undegraded":"2024-04-25T13:17:10.778414+0000","last_fullsized":"2024-04-25T13:17:10.778414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:11.015120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368982+0000","last_change":"2024-04-25T13:16:50.368982+0000","last_active":"2024-04-25T13:16:50.368982+0000","last_peered":"2024-04-25T13:16:50.368982+0000","last_clean":"2024-04-25T13:16:50.368982+0000","last_became_active":"2024-04-25T13:16:50.368538+0000","last_became_peered":"2024-04-25T13:16:50.368538+0000","last_unstale":"2024-04-25T13:16:50.368982+0000","last_undegraded":"2024-04-25T13:16:50.368982+0000","last_fullsized":"2024-04-25T13:16:50.368982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:47.805583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367386+0000","last_change":"2024-04-25T13:16:10.236487+0000","last_active":"2024-04-25T13:16:50.367386+0000","last_peered":"2024-04-25T13:16:50.367386+0000","last_clean":"2024-04-25T13:16:50.367386+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:16:50.367386+0000","last_undegraded":"2024-04-25T13:16:50.367386+0000","last_fullsized":"2024-04-25T13:16:50.367386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:18.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377057+0000","last_change":"2024-04-25T13:16:09.222517+0000","last_active":"2024-04-25T13:16:56.377057+0000","last_peered":"2024-04-25T13:16:56.377057+0000","last_clean":"2024-04-25T13:16:56.377057+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:16:56.377057+0000","last_undegraded":"2024-04-25T13:16:56.377057+0000","last_fullsized":"2024-04-25T13:16:56.377057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:28.282437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364149+0000","last_change":"2024-04-25T13:16:14.261552+0000","last_active":"2024-04-25T13:16:50.364149+0000","last_peered":"2024-04-25T13:16:50.364149+0000","last_clean":"2024-04-25T13:16:50.364149+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:16:50.364149+0000","last_undegraded":"2024-04-25T13:16:50.364149+0000","last_fullsized":"2024-04-25T13:16:50.364149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355622+0000","last_change":"2024-04-25T13:16:10.238736+0000","last_active":"2024-04-25T13:16:50.355622+0000","last_peered":"2024-04-25T13:16:50.355622+0000","last_clean":"2024-04-25T13:16:50.355622+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:16:50.355622+0000","last_undegraded":"2024-04-25T13:16:50.355622+0000","last_fullsized":"2024-04-25T13:16:50.355622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:13.312225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.385844+0000","last_change":"2024-04-25T13:16:09.223447+0000","last_active":"2024-04-25T13:17:02.385844+0000","last_peered":"2024-04-25T13:17:02.385844+0000","last_clean":"2024-04-25T13:17:02.385844+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:17:02.385844+0000","last_undegraded":"2024-04-25T13:17:02.385844+0000","last_fullsized":"2024-04-25T13:17:02.385844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:40.605229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366656+0000","last_change":"2024-04-25T13:16:14.256894+0000","last_active":"2024-04-25T13:16:50.366656+0000","last_peered":"2024-04-25T13:16:50.366656+0000","last_clean":"2024-04-25T13:16:50.366656+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:16:50.366656+0000","last_undegraded":"2024-04-25T13:16:50.366656+0000","last_fullsized":"2024-04-25T13:16:50.366656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:52.431902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354864+0000","last_change":"2024-04-25T13:16:10.237190+0000","last_active":"2024-04-25T13:16:50.354864+0000","last_peered":"2024-04-25T13:16:50.354864+0000","last_clean":"2024-04-25T13:16:50.354864+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:16:50.354864+0000","last_undegraded":"2024-04-25T13:16:50.354864+0000","last_fullsized":"2024-04-25T13:16:50.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:30.650222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356040+0000","last_change":"2024-04-25T13:16:09.230761+0000","last_active":"2024-04-25T13:16:50.356040+0000","last_peered":"2024-04-25T13:16:50.356040+0000","last_clean":"2024-04-25T13:16:50.356040+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:16:50.356040+0000","last_undegraded":"2024-04-25T13:16:50.356040+0000","last_fullsized":"2024-04-25T13:16:50.356040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:43.443034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354663+0000","last_change":"2024-04-25T13:16:14.259841+0000","last_active":"2024-04-25T13:16:50.354663+0000","last_peered":"2024-04-25T13:16:50.354663+0000","last_clean":"2024-04-25T13:16:50.354663+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:16:50.354663+0000","last_undegraded":"2024-04-25T13:16:50.354663+0000","last_fullsized":"2024-04-25T13:16:50.354663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:15.344500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.354424+0000","last_change":"2024-04-25T13:16:10.236628+0000","last_active":"2024-04-25T13:16:50.354424+0000","last_peered":"2024-04-25T13:16:50.354424+0000","last_clean":"2024-04-25T13:16:50.354424+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:16:50.354424+0000","last_undegraded":"2024-04-25T13:16:50.354424+0000","last_fullsized":"2024-04-25T13:16:50.354424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:46.634665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.377581+0000","last_change":"2024-04-25T13:16:09.222996+0000","last_active":"2024-04-25T13:16:56.377581+0000","last_peered":"2024-04-25T13:16:56.377581+0000","last_clean":"2024-04-25T13:16:56.377581+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:16:56.377581+0000","last_undegraded":"2024-04-25T13:16:56.377581+0000","last_fullsized":"2024-04-25T13:16:56.377581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:57.763904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362635+0000","last_change":"2024-04-25T13:16:14.257005+0000","last_active":"2024-04-25T13:16:50.362635+0000","last_peered":"2024-04-25T13:16:50.362635+0000","last_clean":"2024-04-25T13:16:50.362635+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:16:50.362635+0000","last_undegraded":"2024-04-25T13:16:50.362635+0000","last_fullsized":"2024-04-25T13:16:50.362635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356614+0000","last_change":"2024-04-25T13:16:10.231750+0000","last_active":"2024-04-25T13:16:50.356614+0000","last_peered":"2024-04-25T13:16:50.356614+0000","last_clean":"2024-04-25T13:16:50.356614+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:16:50.356614+0000","last_undegraded":"2024-04-25T13:16:50.356614+0000","last_fullsized":"2024-04-25T13:16:50.356614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.093654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.783746+0000","last_change":"2024-04-25T13:16:09.232162+0000","last_active":"2024-04-25T13:17:10.783746+0000","last_peered":"2024-04-25T13:17:10.783746+0000","last_clean":"2024-04-25T13:17:10.783746+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:17:10.783746+0000","last_undegraded":"2024-04-25T13:17:10.783746+0000","last_fullsized":"2024-04-25T13:17:10.783746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:25.347693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357157+0000","last_change":"2024-04-25T13:16:14.264318+0000","last_active":"2024-04-25T13:16:50.357157+0000","last_peered":"2024-04-25T13:16:50.357157+0000","last_clean":"2024-04-25T13:16:50.357157+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:16:50.357157+0000","last_undegraded":"2024-04-25T13:16:50.357157+0000","last_fullsized":"2024-04-25T13:16:50.357157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355199+0000","last_change":"2024-04-25T13:16:10.236066+0000","last_active":"2024-04-25T13:16:50.355199+0000","last_peered":"2024-04-25T13:16:50.355199+0000","last_clean":"2024-04-25T13:16:50.355199+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:16:50.355199+0000","last_undegraded":"2024-04-25T13:16:50.355199+0000","last_fullsized":"2024-04-25T13:16:50.355199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.641810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376519+0000","last_change":"2024-04-25T13:16:09.231699+0000","last_active":"2024-04-25T13:16:56.376519+0000","last_peered":"2024-04-25T13:16:56.376519+0000","last_clean":"2024-04-25T13:16:56.376519+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:16:56.376519+0000","last_undegraded":"2024-04-25T13:16:56.376519+0000","last_fullsized":"2024-04-25T13:16:56.376519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:46.975524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.358023+0000","last_change":"2024-04-25T13:16:14.263593+0000","last_active":"2024-04-25T13:16:50.358023+0000","last_peered":"2024-04-25T13:16:50.358023+0000","last_clean":"2024-04-25T13:16:50.358023+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:16:50.358023+0000","last_undegraded":"2024-04-25T13:16:50.358023+0000","last_fullsized":"2024-04-25T13:16:50.358023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:27.550967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362208+0000","last_change":"2024-04-25T13:16:10.222554+0000","last_active":"2024-04-25T13:16:50.362208+0000","last_peered":"2024-04-25T13:16:50.362208+0000","last_clean":"2024-04-25T13:16:50.362208+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:16:50.362208+0000","last_undegraded":"2024-04-25T13:16:50.362208+0000","last_fullsized":"2024-04-25T13:16:50.362208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.388406+0000","last_change":"2024-04-25T13:16:09.220951+0000","last_active":"2024-04-25T13:17:02.388406+0000","last_peered":"2024-04-25T13:17:02.388406+0000","last_clean":"2024-04-25T13:17:02.388406+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:17:02.388406+0000","last_undegraded":"2024-04-25T13:17:02.388406+0000","last_fullsized":"2024-04-25T13:17:02.388406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368372+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:50.368372+0000","last_peered":"2024-04-25T13:16:50.368372+0000","last_clean":"2024-04-25T13:16:50.368372+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:50.368372+0000","last_undegraded":"2024-04-25T13:16:50.368372+0000","last_fullsized":"2024-04-25T13:16:50.368372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:22.393323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355360+0000","last_change":"2024-04-25T13:16:10.235016+0000","last_active":"2024-04-25T13:16:50.355360+0000","last_peered":"2024-04-25T13:16:50.355360+0000","last_clean":"2024-04-25T13:16:50.355360+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:16:50.355360+0000","last_undegraded":"2024-04-25T13:16:50.355360+0000","last_fullsized":"2024-04-25T13:16:50.355360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:23.184610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.988017+0000","last_change":"2024-04-25T13:16:09.228704+0000","last_active":"2024-04-25T13:17:10.988017+0000","last_peered":"2024-04-25T13:17:10.988017+0000","last_clean":"2024-04-25T13:17:10.988017+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:17:10.988017+0000","last_undegraded":"2024-04-25T13:17:10.988017+0000","last_fullsized":"2024-04-25T13:17:10.988017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:11.251684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364968+0000","last_change":"2024-04-25T13:16:14.257279+0000","last_active":"2024-04-25T13:16:50.364968+0000","last_peered":"2024-04-25T13:16:50.364968+0000","last_clean":"2024-04-25T13:16:50.364968+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:16:50.364968+0000","last_undegraded":"2024-04-25T13:16:50.364968+0000","last_fullsized":"2024-04-25T13:16:50.364968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:35.383760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355772+0000","last_change":"2024-04-25T13:16:10.229439+0000","last_active":"2024-04-25T13:16:50.355772+0000","last_peered":"2024-04-25T13:16:50.355772+0000","last_clean":"2024-04-25T13:16:50.355772+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:16:50.355772+0000","last_undegraded":"2024-04-25T13:16:50.355772+0000","last_fullsized":"2024-04-25T13:16:50.355772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:40.176761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364593+0000","last_change":"2024-04-25T13:16:09.229489+0000","last_active":"2024-04-25T13:16:50.364593+0000","last_peered":"2024-04-25T13:16:50.364593+0000","last_clean":"2024-04-25T13:16:50.364593+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:16:50.364593+0000","last_undegraded":"2024-04-25T13:16:50.364593+0000","last_fullsized":"2024-04-25T13:16:50.364593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:12.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355323+0000","last_change":"2024-04-25T13:16:14.254502+0000","last_active":"2024-04-25T13:16:50.355323+0000","last_peered":"2024-04-25T13:16:50.355323+0000","last_clean":"2024-04-25T13:16:50.355323+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:16:50.355323+0000","last_undegraded":"2024-04-25T13:16:50.355323+0000","last_fullsized":"2024-04-25T13:16:50.355323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:56.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363773+0000","last_change":"2024-04-25T13:16:10.236726+0000","last_active":"2024-04-25T13:16:50.363773+0000","last_peered":"2024-04-25T13:16:50.363773+0000","last_clean":"2024-04-25T13:16:50.363773+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:16:50.363773+0000","last_undegraded":"2024-04-25T13:16:50.363773+0000","last_fullsized":"2024-04-25T13:16:50.363773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.391208+0000","last_change":"2024-04-25T13:16:09.233091+0000","last_active":"2024-04-25T13:17:02.391208+0000","last_peered":"2024-04-25T13:17:02.391208+0000","last_clean":"2024-04-25T13:17:02.391208+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:17:02.391208+0000","last_undegraded":"2024-04-25T13:17:02.391208+0000","last_fullsized":"2024-04-25T13:17:02.391208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:07.947008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356204+0000","last_change":"2024-04-25T13:16:14.265306+0000","last_active":"2024-04-25T13:16:50.356204+0000","last_peered":"2024-04-25T13:16:50.356204+0000","last_clean":"2024-04-25T13:16:50.356204+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:16:50.356204+0000","last_undegraded":"2024-04-25T13:16:50.356204+0000","last_fullsized":"2024-04-25T13:16:50.356204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:44.540794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367495+0000","last_change":"2024-04-25T13:16:10.241140+0000","last_active":"2024-04-25T13:16:50.367495+0000","last_peered":"2024-04-25T13:16:50.367495+0000","last_clean":"2024-04-25T13:16:50.367495+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:16:50.367495+0000","last_undegraded":"2024-04-25T13:16:50.367495+0000","last_fullsized":"2024-04-25T13:16:50.367495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:53.196676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781217+0000","last_change":"2024-04-25T13:16:09.234806+0000","last_active":"2024-04-25T13:17:10.781217+0000","last_peered":"2024-04-25T13:17:10.781217+0000","last_clean":"2024-04-25T13:17:10.781217+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:17:10.781217+0000","last_undegraded":"2024-04-25T13:17:10.781217+0000","last_fullsized":"2024-04-25T13:17:10.781217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:31.586329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355305+0000","last_change":"2024-04-25T13:16:14.264408+0000","last_active":"2024-04-25T13:16:50.355305+0000","last_peered":"2024-04-25T13:16:50.355305+0000","last_clean":"2024-04-25T13:16:50.355305+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:16:50.355305+0000","last_undegraded":"2024-04-25T13:16:50.355305+0000","last_fullsized":"2024-04-25T13:16:50.355305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:47.137588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362502+0000","last_change":"2024-04-25T13:16:14.259141+0000","last_active":"2024-04-25T13:16:50.362502+0000","last_peered":"2024-04-25T13:16:50.362502+0000","last_clean":"2024-04-25T13:16:50.362502+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:16:50.362502+0000","last_undegraded":"2024-04-25T13:16:50.362502+0000","last_fullsized":"2024-04-25T13:16:50.362502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363321+0000","last_change":"2024-04-25T13:16:10.231920+0000","last_active":"2024-04-25T13:16:50.363321+0000","last_peered":"2024-04-25T13:16:50.363321+0000","last_clean":"2024-04-25T13:16:50.363321+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:16:50.363321+0000","last_undegraded":"2024-04-25T13:16:50.363321+0000","last_fullsized":"2024-04-25T13:16:50.363321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:47.738232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376012+0000","last_change":"2024-04-25T13:16:09.226346+0000","last_active":"2024-04-25T13:16:56.376012+0000","last_peered":"2024-04-25T13:16:56.376012+0000","last_clean":"2024-04-25T13:16:56.376012+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:16:56.376012+0000","last_undegraded":"2024-04-25T13:16:56.376012+0000","last_fullsized":"2024-04-25T13:16:56.376012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:48.472115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357030+0000","last_change":"2024-04-25T13:16:14.253568+0000","last_active":"2024-04-25T13:16:50.357030+0000","last_peered":"2024-04-25T13:16:50.357030+0000","last_clean":"2024-04-25T13:16:50.357030+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:16:50.357030+0000","last_undegraded":"2024-04-25T13:16:50.357030+0000","last_fullsized":"2024-04-25T13:16:50.357030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372604+0000","last_change":"2024-04-25T13:16:50.370489+0000","last_active":"2024-04-25T13:16:50.372604+0000","last_peered":"2024-04-25T13:16:50.372604+0000","last_clean":"2024-04-25T13:16:50.372604+0000","last_became_active":"2024-04-25T13:16:50.370143+0000","last_became_peered":"2024-04-25T13:16:50.370143+0000","last_unstale":"2024-04-25T13:16:50.372604+0000","last_undegraded":"2024-04-25T13:16:50.372604+0000","last_fullsized":"2024-04-25T13:16:50.372604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:06.845107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365416+0000","last_change":"2024-04-25T13:16:09.233109+0000","last_active":"2024-04-25T13:16:50.365416+0000","last_peered":"2024-04-25T13:16:50.365416+0000","last_clean":"2024-04-25T13:16:50.365416+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:16:50.365416+0000","last_undegraded":"2024-04-25T13:16:50.365416+0000","last_fullsized":"2024-04-25T13:16:50.365416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:37.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.376785+0000","last_change":"2024-04-25T13:16:09.233145+0000","last_active":"2024-04-25T13:16:56.376785+0000","last_peered":"2024-04-25T13:16:56.376785+0000","last_clean":"2024-04-25T13:16:56.376785+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:16:56.376785+0000","last_undegraded":"2024-04-25T13:16:56.376785+0000","last_fullsized":"2024-04-25T13:16:56.376785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.562195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364284+0000","last_change":"2024-04-25T13:16:10.232914+0000","last_active":"2024-04-25T13:16:50.364284+0000","last_peered":"2024-04-25T13:16:50.364284+0000","last_clean":"2024-04-25T13:16:50.364284+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:16:50.364284+0000","last_undegraded":"2024-04-25T13:16:50.364284+0000","last_fullsized":"2024-04-25T13:16:50.364284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366699+0000","last_change":"2024-04-25T13:16:14.266381+0000","last_active":"2024-04-25T13:16:50.366699+0000","last_peered":"2024-04-25T13:16:50.366699+0000","last_clean":"2024-04-25T13:16:50.366699+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:16:50.366699+0000","last_undegraded":"2024-04-25T13:16:50.366699+0000","last_fullsized":"2024-04-25T13:16:50.366699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:03.277921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.781407+0000","last_change":"2024-04-25T13:16:09.228526+0000","last_active":"2024-04-25T13:17:10.781407+0000","last_peered":"2024-04-25T13:17:10.781407+0000","last_clean":"2024-04-25T13:17:10.781407+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:17:10.781407+0000","last_undegraded":"2024-04-25T13:17:10.781407+0000","last_fullsized":"2024-04-25T13:17:10.781407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:08.197757+0000","last_clean_scrub_stamp":"2024-04-25T13:16:08.197757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:29.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356066+0000","last_change":"2024-04-25T13:16:10.228698+0000","last_active":"2024-04-25T13:16:50.356066+0000","last_peered":"2024-04-25T13:16:50.356066+0000","last_clean":"2024-04-25T13:16:50.356066+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:16:50.356066+0000","last_undegraded":"2024-04-25T13:16:50.356066+0000","last_fullsized":"2024-04-25T13:16:50.356066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:19.400969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357602+0000","last_change":"2024-04-25T13:16:14.269417+0000","last_active":"2024-04-25T13:16:50.357602+0000","last_peered":"2024-04-25T13:16:50.357602+0000","last_clean":"2024-04-25T13:16:50.357602+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:16:50.357602+0000","last_undegraded":"2024-04-25T13:16:50.357602+0000","last_fullsized":"2024-04-25T13:16:50.357602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:18.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356114+0000","last_change":"2024-04-25T13:16:10.232435+0000","last_active":"2024-04-25T13:16:50.356114+0000","last_peered":"2024-04-25T13:16:50.356114+0000","last_clean":"2024-04-25T13:16:50.356114+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:16:50.356114+0000","last_undegraded":"2024-04-25T13:16:50.356114+0000","last_fullsized":"2024-04-25T13:16:50.356114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:47.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366795+0000","last_change":"2024-04-25T13:16:10.234681+0000","last_active":"2024-04-25T13:16:50.366795+0000","last_peered":"2024-04-25T13:16:50.366795+0000","last_clean":"2024-04-25T13:16:50.366795+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:16:50.366795+0000","last_undegraded":"2024-04-25T13:16:50.366795+0000","last_fullsized":"2024-04-25T13:16:50.366795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.220587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366978+0000","last_change":"2024-04-25T13:16:10.236316+0000","last_active":"2024-04-25T13:16:50.366978+0000","last_peered":"2024-04-25T13:16:50.366978+0000","last_clean":"2024-04-25T13:16:50.366978+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:16:50.366978+0000","last_undegraded":"2024-04-25T13:16:50.366978+0000","last_fullsized":"2024-04-25T13:16:50.366978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:57.960373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364180+0000","last_change":"2024-04-25T13:16:10.229472+0000","last_active":"2024-04-25T13:16:50.364180+0000","last_peered":"2024-04-25T13:16:50.364180+0000","last_clean":"2024-04-25T13:16:50.364180+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:16:50.364180+0000","last_undegraded":"2024-04-25T13:16:50.364180+0000","last_fullsized":"2024-04-25T13:16:50.364180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372415+0000","last_change":"2024-04-25T13:16:50.369947+0000","last_active":"2024-04-25T13:16:50.372415+0000","last_peered":"2024-04-25T13:16:50.372415+0000","last_clean":"2024-04-25T13:16:50.372415+0000","last_became_active":"2024-04-25T13:16:50.369437+0000","last_became_peered":"2024-04-25T13:16:50.369437+0000","last_unstale":"2024-04-25T13:16:50.372415+0000","last_undegraded":"2024-04-25T13:16:50.372415+0000","last_fullsized":"2024-04-25T13:16:50.372415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:26.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363154+0000","last_change":"2024-04-25T13:16:10.230593+0000","last_active":"2024-04-25T13:16:50.363154+0000","last_peered":"2024-04-25T13:16:50.363154+0000","last_clean":"2024-04-25T13:16:50.363154+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:16:50.363154+0000","last_undegraded":"2024-04-25T13:16:50.363154+0000","last_fullsized":"2024-04-25T13:16:50.363154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:31.307564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357306+0000","last_change":"2024-04-25T13:16:10.233952+0000","last_active":"2024-04-25T13:16:50.357306+0000","last_peered":"2024-04-25T13:16:50.357306+0000","last_clean":"2024-04-25T13:16:50.357306+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:16:50.357306+0000","last_undegraded":"2024-04-25T13:16:50.357306+0000","last_fullsized":"2024-04-25T13:16:50.357306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:35.774208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357159+0000","last_change":"2024-04-25T13:16:10.236868+0000","last_active":"2024-04-25T13:16:50.357159+0000","last_peered":"2024-04-25T13:16:50.357159+0000","last_clean":"2024-04-25T13:16:50.357159+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:16:50.357159+0000","last_undegraded":"2024-04-25T13:16:50.357159+0000","last_fullsized":"2024-04-25T13:16:50.357159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:29.729554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366748+0000","last_change":"2024-04-25T13:16:10.238944+0000","last_active":"2024-04-25T13:16:50.366748+0000","last_peered":"2024-04-25T13:16:50.366748+0000","last_clean":"2024-04-25T13:16:50.366748+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:16:50.366748+0000","last_undegraded":"2024-04-25T13:16:50.366748+0000","last_fullsized":"2024-04-25T13:16:50.366748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:57.082241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355469+0000","last_change":"2024-04-25T13:16:10.236905+0000","last_active":"2024-04-25T13:16:50.355469+0000","last_peered":"2024-04-25T13:16:50.355469+0000","last_clean":"2024-04-25T13:16:50.355469+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:16:50.355469+0000","last_undegraded":"2024-04-25T13:16:50.355469+0000","last_fullsized":"2024-04-25T13:16:50.355469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:03.100130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366885+0000","last_change":"2024-04-25T13:16:10.233361+0000","last_active":"2024-04-25T13:16:50.366885+0000","last_peered":"2024-04-25T13:16:50.366885+0000","last_clean":"2024-04-25T13:16:50.366885+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:16:50.366885+0000","last_undegraded":"2024-04-25T13:16:50.366885+0000","last_fullsized":"2024-04-25T13:16:50.366885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.538644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.364027+0000","last_change":"2024-04-25T13:16:10.230303+0000","last_active":"2024-04-25T13:16:50.364027+0000","last_peered":"2024-04-25T13:16:50.364027+0000","last_clean":"2024-04-25T13:16:50.364027+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:16:50.364027+0000","last_undegraded":"2024-04-25T13:16:50.364027+0000","last_fullsized":"2024-04-25T13:16:50.364027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357173+0000","last_change":"2024-04-25T13:16:10.236735+0000","last_active":"2024-04-25T13:16:50.357173+0000","last_peered":"2024-04-25T13:16:50.357173+0000","last_clean":"2024-04-25T13:16:50.357173+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:16:50.357173+0000","last_undegraded":"2024-04-25T13:16:50.357173+0000","last_fullsized":"2024-04-25T13:16:50.357173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:21.772668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355881+0000","last_change":"2024-04-25T13:16:10.229098+0000","last_active":"2024-04-25T13:16:50.355881+0000","last_peered":"2024-04-25T13:16:50.355881+0000","last_clean":"2024-04-25T13:16:50.355881+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:16:50.355881+0000","last_undegraded":"2024-04-25T13:16:50.355881+0000","last_fullsized":"2024-04-25T13:16:50.355881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:34.477268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366734+0000","last_change":"2024-04-25T13:16:10.232555+0000","last_active":"2024-04-25T13:16:50.366734+0000","last_peered":"2024-04-25T13:16:50.366734+0000","last_clean":"2024-04-25T13:16:50.366734+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:16:50.366734+0000","last_undegraded":"2024-04-25T13:16:50.366734+0000","last_fullsized":"2024-04-25T13:16:50.366734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:52.989303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367697+0000","last_change":"2024-04-25T13:16:10.233429+0000","last_active":"2024-04-25T13:16:50.367697+0000","last_peered":"2024-04-25T13:16:50.367697+0000","last_clean":"2024-04-25T13:16:50.367697+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:16:50.367697+0000","last_undegraded":"2024-04-25T13:16:50.367697+0000","last_fullsized":"2024-04-25T13:16:50.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:23.566818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366727+0000","last_change":"2024-04-25T13:16:10.235253+0000","last_active":"2024-04-25T13:16:50.366727+0000","last_peered":"2024-04-25T13:16:50.366727+0000","last_clean":"2024-04-25T13:16:50.366727+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:16:50.366727+0000","last_undegraded":"2024-04-25T13:16:50.366727+0000","last_fullsized":"2024-04-25T13:16:50.366727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363431+0000","last_change":"2024-04-25T13:16:10.236465+0000","last_active":"2024-04-25T13:16:50.363431+0000","last_peered":"2024-04-25T13:16:50.363431+0000","last_clean":"2024-04-25T13:16:50.363431+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:16:50.363431+0000","last_undegraded":"2024-04-25T13:16:50.363431+0000","last_fullsized":"2024-04-25T13:16:50.363431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.286962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362102+0000","last_change":"2024-04-25T13:16:10.225905+0000","last_active":"2024-04-25T13:16:50.362102+0000","last_peered":"2024-04-25T13:16:50.362102+0000","last_clean":"2024-04-25T13:16:50.362102+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:16:50.362102+0000","last_undegraded":"2024-04-25T13:16:50.362102+0000","last_fullsized":"2024-04-25T13:16:50.362102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356705+0000","last_change":"2024-04-25T13:16:10.235046+0000","last_active":"2024-04-25T13:16:50.356705+0000","last_peered":"2024-04-25T13:16:50.356705+0000","last_clean":"2024-04-25T13:16:50.356705+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:16:50.356705+0000","last_undegraded":"2024-04-25T13:16:50.356705+0000","last_fullsized":"2024-04-25T13:16:50.356705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:06.429141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355690+0000","last_change":"2024-04-25T13:16:10.231052+0000","last_active":"2024-04-25T13:16:50.355690+0000","last_peered":"2024-04-25T13:16:50.355690+0000","last_clean":"2024-04-25T13:16:50.355690+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:16:50.355690+0000","last_undegraded":"2024-04-25T13:16:50.355690+0000","last_fullsized":"2024-04-25T13:16:50.355690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:51.515968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357158+0000","last_change":"2024-04-25T13:16:10.238556+0000","last_active":"2024-04-25T13:16:50.357158+0000","last_peered":"2024-04-25T13:16:50.357158+0000","last_clean":"2024-04-25T13:16:50.357158+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:16:50.357158+0000","last_undegraded":"2024-04-25T13:16:50.357158+0000","last_fullsized":"2024-04-25T13:16:50.357158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.410946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.357282+0000","last_change":"2024-04-25T13:16:10.239455+0000","last_active":"2024-04-25T13:16:50.357282+0000","last_peered":"2024-04-25T13:16:50.357282+0000","last_clean":"2024-04-25T13:16:50.357282+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:16:50.357282+0000","last_undegraded":"2024-04-25T13:16:50.357282+0000","last_fullsized":"2024-04-25T13:16:50.357282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:40.030593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.365616+0000","last_change":"2024-04-25T13:16:50.365616+0000","last_active":"2024-04-25T13:16:50.365616+0000","last_peered":"2024-04-25T13:16:50.365616+0000","last_clean":"2024-04-25T13:16:50.365616+0000","last_became_active":"2024-04-25T13:16:50.365415+0000","last_became_peered":"2024-04-25T13:16:50.365415+0000","last_unstale":"2024-04-25T13:16:50.365616+0000","last_undegraded":"2024-04-25T13:16:50.365616+0000","last_fullsized":"2024-04-25T13:16:50.365616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:37.667075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.356014+0000","last_change":"2024-04-25T13:16:10.240275+0000","last_active":"2024-04-25T13:16:50.356014+0000","last_peered":"2024-04-25T13:16:50.356014+0000","last_clean":"2024-04-25T13:16:50.356014+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:16:50.356014+0000","last_undegraded":"2024-04-25T13:16:50.356014+0000","last_fullsized":"2024-04-25T13:16:50.356014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:44.552115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.372305+0000","last_change":"2024-04-25T13:16:50.370418+0000","last_active":"2024-04-25T13:16:50.372305+0000","last_peered":"2024-04-25T13:16:50.372305+0000","last_clean":"2024-04-25T13:16:50.372305+0000","last_became_active":"2024-04-25T13:16:50.370066+0000","last_became_peered":"2024-04-25T13:16:50.370066+0000","last_unstale":"2024-04-25T13:16:50.372305+0000","last_undegraded":"2024-04-25T13:16:50.372305+0000","last_fullsized":"2024-04-25T13:16:50.372305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:17.756850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366860+0000","last_change":"2024-04-25T13:16:10.231231+0000","last_active":"2024-04-25T13:16:50.366860+0000","last_peered":"2024-04-25T13:16:50.366860+0000","last_clean":"2024-04-25T13:16:50.366860+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:16:50.366860+0000","last_undegraded":"2024-04-25T13:16:50.366860+0000","last_fullsized":"2024-04-25T13:16:50.366860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:30.825866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355061+0000","last_change":"2024-04-25T13:16:10.229124+0000","last_active":"2024-04-25T13:16:50.355061+0000","last_peered":"2024-04-25T13:16:50.355061+0000","last_clean":"2024-04-25T13:16:50.355061+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:16:50.355061+0000","last_undegraded":"2024-04-25T13:16:50.355061+0000","last_fullsized":"2024-04-25T13:16:50.355061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:45.768767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.367300+0000","last_change":"2024-04-25T13:16:10.238838+0000","last_active":"2024-04-25T13:16:50.367300+0000","last_peered":"2024-04-25T13:16:50.367300+0000","last_clean":"2024-04-25T13:16:50.367300+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:16:50.367300+0000","last_undegraded":"2024-04-25T13:16:50.367300+0000","last_fullsized":"2024-04-25T13:16:50.367300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:04.237593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.363268+0000","last_change":"2024-04-25T13:16:10.221361+0000","last_active":"2024-04-25T13:16:50.363268+0000","last_peered":"2024-04-25T13:16:50.363268+0000","last_clean":"2024-04-25T13:16:50.363268+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:16:50.363268+0000","last_undegraded":"2024-04-25T13:16:50.363268+0000","last_fullsized":"2024-04-25T13:16:50.363268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.362907+0000","last_change":"2024-04-25T13:16:10.226374+0000","last_active":"2024-04-25T13:16:50.362907+0000","last_peered":"2024-04-25T13:16:50.362907+0000","last_clean":"2024-04-25T13:16:50.362907+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:16:50.362907+0000","last_undegraded":"2024-04-25T13:16:50.362907+0000","last_fullsized":"2024-04-25T13:16:50.362907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:01.129318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.355523+0000","last_change":"2024-04-25T13:16:10.233753+0000","last_active":"2024-04-25T13:16:50.355523+0000","last_peered":"2024-04-25T13:16:50.355523+0000","last_clean":"2024-04-25T13:16:50.355523+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:16:50.355523+0000","last_undegraded":"2024-04-25T13:16:50.355523+0000","last_fullsized":"2024-04-25T13:16:50.355523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:28.756027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":120093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:29.515 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.515 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.515 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.516 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.516 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.516 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.516 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.516 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.516 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.516 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.517 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.517 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.517 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.517 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.517 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.517 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.518 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.518 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.518 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.518 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.518 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.518 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.518 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.519 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.519 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.519 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.519 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.519 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.519 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.519 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.520 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.520 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.520 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.520 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.520 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.520 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.520 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.521 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.522 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.522 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.522 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T13:15:56.163882+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=15, tm_sec=56, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.522 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.522 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.522 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.523 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.523 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.523 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.523 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.523 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.523 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.524 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.524 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.524 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.524 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.524 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.524 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.525 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.525 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.525 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.525 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.525 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.525 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.525 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.526 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.526 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.526 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.526 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.526 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.526 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.527 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.527 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.527 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.527 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.527 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.527 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.527 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.528 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.528 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.528 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.528 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.528 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.528 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.528 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T13:16:08.197757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.529 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.530 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.530 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.530 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.530 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.530 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.530 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.531 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.531 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.531 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.531 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.531 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.531 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.531 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.532 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.532 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.532 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.532 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.532 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.532 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.532 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.533 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.533 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.533 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.533 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.533 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.533 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.533 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.534 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.534 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.534 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.534 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:29.534 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T13:17:36.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:36.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:49.535 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.648+0000 7f85eddc6640 1 Processor -- start 2024-04-25T13:17:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.648+0000 7f85eddc6640 1 -- start start 2024-04-25T13:17:49.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85eddc6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85e806bf70 0x7f85e815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:49.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85eddc6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e815bef0 con 0x7f85e80c99f0 2024-04-25T13:17:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85eddc6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e815b650 con 0x7f85e806bb90 2024-04-25T13:17:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85eddc6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f85e815f510 con 0x7f85e806bf70 2024-04-25T13:17:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85e6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85e806bf70 0x7f85e815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85e7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85e80c99f0 0x7f85e8154db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58750/0 (socket says 172.21.15.26:58750) 2024-04-25T13:17:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85e7fff640 1 -- 172.21.15.26:0/2237660999 learned_addr learned my addr 172.21.15.26:0/2237660999 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:17:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85e6ffd640 1 -- 172.21.15.26:0/2237660999 >> v1:172.21.15.169:6789/0 conn(0x7f85e806bb90 legacy=0x7f85e815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85e6ffd640 1 -- 172.21.15.26:0/2237660999 >> v1:172.21.15.26:6789/0 conn(0x7f85e80c99f0 legacy=0x7f85e8154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85e6ffd640 1 -- 172.21.15.26:0/2237660999 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e815b930 con 0x7f85e806bf70 2024-04-25T13:17:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.649+0000 7f85e67fc640 1 -- 172.21.15.26:0/2237660999 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939580822 0 0) 0x7f85e815bef0 con 0x7f85e80c99f0 2024-04-25T13:17:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.650+0000 7f85e6ffd640 1 --2- 172.21.15.26:0/2237660999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e806bf70 0x7f85e815af70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0097a0 tx=0x7f85dc02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d77734324bceed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.650+0000 7f85e67fc640 1 -- 172.21.15.26:0/2237660999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc037070 con 0x7f85e806bf70 2024-04-25T13:17:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.650+0000 7f85e67fc640 1 -- 172.21.15.26:0/2237660999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc032640 con 0x7f85e806bf70 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.650+0000 7f85e67fc640 1 -- 172.21.15.26:0/2237660999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc032a10 con 0x7f85e806bf70 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.651+0000 7f85eddc6640 1 -- 172.21.15.26:0/2237660999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e806bf70 msgr2=0x7f85e815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.651+0000 7f85eddc6640 1 --2- 172.21.15.26:0/2237660999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e806bf70 0x7f85e815af70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0097a0 tx=0x7f85dc02a2c0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.651+0000 7f85eddc6640 1 -- 172.21.15.26:0/2237660999 shutdown_connections 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.651+0000 7f85eddc6640 1 --2- 172.21.15.26:0/2237660999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e806bf70 0x7f85e815af70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.651+0000 7f85eddc6640 1 -- 172.21.15.26:0/2237660999 >> 172.21.15.26:0/2237660999 conn(0x7f85e8074d50 msgr2=0x7f85e8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.651+0000 7f85eddc6640 1 -- 172.21.15.26:0/2237660999 shutdown_connections 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.651+0000 7f85eddc6640 1 -- 172.21.15.26:0/2237660999 wait complete. 2024-04-25T13:17:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.652+0000 7f85eddc6640 1 Processor -- start 2024-04-25T13:17:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.652+0000 7f85eddc6640 1 -- start start 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85eddc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85e806bb90 0x7f85e81f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85eddc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85e806bf70 0x7f85e81f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85eddc6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e80c99f0 0x7f85e814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85eddc6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f85e815e8e0 con 0x7f85e80c99f0 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85eddc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85e815e600 con 0x7f85e806bb90 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85eddc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f85e8074560 con 0x7f85e806bf70 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e80c99f0 0x7f85e814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e80c99f0 0x7f85e814afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51596/0 (socket says 172.21.15.26:51596) 2024-04-25T13:17:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 -- 172.21.15.26:0/3867610277 learned_addr learned my addr 172.21.15.26:0/3867610277 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e77fe640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85e806bb90 0x7f85e81f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e6ffd640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85e806bf70 0x7f85e81f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 -- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85e806bf70 msgr2=0x7f85e81f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85e806bf70 0x7f85e81f3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 -- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85e806bb90 msgr2=0x7f85e81f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85e806bb90 0x7f85e81f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e7fff640 1 -- 172.21.15.26:0/3867610277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e81f26d0 con 0x7f85e80c99f0 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.653+0000 7f85e77fe640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85e806bb90 0x7f85e81f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.654+0000 7f85e7fff640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e80c99f0 0x7f85e814afe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c7a0 tx=0x7f85e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.654+0000 7f85cffff640 1 -- 172.21.15.26:0/3867610277 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0018070 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.654+0000 7f85cffff640 1 -- 172.21.15.26:0/3867610277 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e000a640 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.654+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e8151f60 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.654+0000 7f85cffff640 1 -- 172.21.15.26:0/3867610277 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e000aab0 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.654+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e81f2c20 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.655+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e8152d80 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.655+0000 7f85cffff640 1 -- 172.21.15.26:0/3867610277 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85e001b070 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.656+0000 7f85cffff640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f85d406c8f0 0x7f85d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.656+0000 7f85cffff640 1 -- 172.21.15.26:0/3867610277 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f85e008b5e0 con 0x7f85e80c99f0 2024-04-25T13:17:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.656+0000 7f85e77fe640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f85d406c8f0 0x7f85d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.657+0000 7f85e77fe640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f85d406c8f0 0x7f85d406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000f60 tx=0x7f85d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.660+0000 7f85cffff640 1 -- 172.21.15.26:0/3867610277 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f85e8152d80 con 0x7f85e80c99f0 2024-04-25T13:17:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.841+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85e80734e0 con 0x7f85d406c8f0 2024-04-25T13:17:49.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.850+0000 7f85cffff640 1 -- 172.21.15.26:0/3867610277 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332657 (secure 0 0 0) 0x7f85e80734e0 con 0x7f85d406c8f0 2024-04-25T13:17:49.854 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:17:49.856 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:17:49.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f85d406c8f0 msgr2=0x7f85d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f85d406c8f0 0x7f85d406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000f60 tx=0x7f85d8009040 comp rx=0 tx=0).stop 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e80c99f0 msgr2=0x7f85e814afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e80c99f0 0x7f85e814afe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c7a0 tx=0x7f85e000cc60 comp rx=0 tx=0).stop 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 shutdown_connections 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f85d406c8f0 0x7f85d406edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e80c99f0 0x7f85e814afe0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85e806bf70 0x7f85e81f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 --2- 172.21.15.26:0/3867610277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85e806bb90 0x7f85e81f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 >> 172.21.15.26:0/3867610277 conn(0x7f85e8074d50 msgr2=0x7f85e8154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 shutdown_connections 2024-04-25T13:17:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:17:49.853+0000 7f85eddc6640 1 -- 172.21.15.26:0/3867610277 wait complete. 2024-04-25T13:17:49.865 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-04-25T13:17:49.186555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003275"},"pg_stats":[{"pgid":"2.1f","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.700223+0000","last_change":"2024-04-25T13:17:28.700254+0000","last_active":"2024-04-25T13:17:28.700223+0000","last_peered":"2024-04-25T13:17:28.700223+0000","last_clean":"2024-04-25T13:17:28.700223+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:17:28.700223+0000","last_undegraded":"2024-04-25T13:17:28.700223+0000","last_fullsized":"2024-04-25T13:17:28.700223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T13:17:28.700161+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T13:17:28.700161+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.700161+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:05.837904+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.267440+0000","last_change":"2024-04-25T13:17:37.267466+0000","last_active":"2024-04-25T13:17:37.267440+0000","last_peered":"2024-04-25T13:17:37.267440+0000","last_clean":"2024-04-25T13:17:37.267440+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:17:37.267440+0000","last_undegraded":"2024-04-25T13:17:37.267440+0000","last_fullsized":"2024-04-25T13:17:37.267440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.267359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.267359+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.267359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:23.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.340999+0000","last_change":"2024-04-25T13:17:39.341027+0000","last_active":"2024-04-25T13:17:39.340999+0000","last_peered":"2024-04-25T13:17:39.340999+0000","last_clean":"2024-04-25T13:17:39.340999+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:17:39.340999+0000","last_undegraded":"2024-04-25T13:17:39.340999+0000","last_fullsized":"2024-04-25T13:17:39.340999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.340909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.340909+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.340909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:18.806485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.271377+0000","last_change":"2024-04-25T13:17:31.271428+0000","last_active":"2024-04-25T13:17:31.271377+0000","last_peered":"2024-04-25T13:17:31.271377+0000","last_clean":"2024-04-25T13:17:31.271377+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:17:31.271377+0000","last_undegraded":"2024-04-25T13:17:31.271377+0000","last_fullsized":"2024-04-25T13:17:31.271377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-25T13:17:31.271258+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-25T13:17:31.271258+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.271258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:54.598547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.743663+0000","last_change":"2024-04-25T13:17:37.743689+0000","last_active":"2024-04-25T13:17:37.743663+0000","last_peered":"2024-04-25T13:17:37.743663+0000","last_clean":"2024-04-25T13:17:37.743663+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:17:37.743663+0000","last_undegraded":"2024-04-25T13:17:37.743663+0000","last_fullsized":"2024-04-25T13:17:37.743663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.743559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.743559+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.743559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:13.860985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.617294+0000","last_change":"2024-04-25T13:17:41.617322+0000","last_active":"2024-04-25T13:17:41.617294+0000","last_peered":"2024-04-25T13:17:41.617294+0000","last_clean":"2024-04-25T13:17:41.617294+0000","last_became_active":"2024-04-25T13:16:50.361435+0000","last_became_peered":"2024-04-25T13:16:50.361435+0000","last_unstale":"2024-04-25T13:17:41.617294+0000","last_undegraded":"2024-04-25T13:17:41.617294+0000","last_fullsized":"2024-04-25T13:17:41.617294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.617198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.617198+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.617198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:13.214379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.131385+0000","last_change":"2024-04-25T13:17:37.131426+0000","last_active":"2024-04-25T13:17:37.131385+0000","last_peered":"2024-04-25T13:17:37.131385+0000","last_clean":"2024-04-25T13:17:37.131385+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:17:37.131385+0000","last_undegraded":"2024-04-25T13:17:37.131385+0000","last_fullsized":"2024-04-25T13:17:37.131385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T13:17:37.131304+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T13:17:37.131304+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.131304+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:36.321695+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.157584+0000","last_change":"2024-04-25T13:17:43.157622+0000","last_active":"2024-04-25T13:17:43.157584+0000","last_peered":"2024-04-25T13:17:43.157584+0000","last_clean":"2024-04-25T13:17:43.157584+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:17:43.157584+0000","last_undegraded":"2024-04-25T13:17:43.157584+0000","last_fullsized":"2024-04-25T13:17:43.157584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.157480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.157480+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.157480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:04.681722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.589105+0000","last_change":"2024-04-25T13:17:37.589149+0000","last_active":"2024-04-25T13:17:37.589105+0000","last_peered":"2024-04-25T13:17:37.589105+0000","last_clean":"2024-04-25T13:17:37.589105+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:17:37.589105+0000","last_undegraded":"2024-04-25T13:17:37.589105+0000","last_fullsized":"2024-04-25T13:17:37.589105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.589002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.589002+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.589002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:00.306087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.146370+0000","last_change":"2024-04-25T13:17:32.146417+0000","last_active":"2024-04-25T13:17:32.146370+0000","last_peered":"2024-04-25T13:17:32.146370+0000","last_clean":"2024-04-25T13:17:32.146370+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:17:32.146370+0000","last_undegraded":"2024-04-25T13:17:32.146370+0000","last_fullsized":"2024-04-25T13:17:32.146370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:32.146285+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:32.146285+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.146285+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:37.180242+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.193508+0000","last_change":"2024-04-25T13:17:44.193531+0000","last_active":"2024-04-25T13:17:44.193508+0000","last_peered":"2024-04-25T13:17:44.193508+0000","last_clean":"2024-04-25T13:17:44.193508+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:17:44.193508+0000","last_undegraded":"2024-04-25T13:17:44.193508+0000","last_fullsized":"2024-04-25T13:17:44.193508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.193428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.193428+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.193428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:35.455927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.607821+0000","last_change":"2024-04-25T13:17:39.607857+0000","last_active":"2024-04-25T13:17:39.607821+0000","last_peered":"2024-04-25T13:17:39.607821+0000","last_clean":"2024-04-25T13:17:39.607821+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:17:39.607821+0000","last_undegraded":"2024-04-25T13:17:39.607821+0000","last_fullsized":"2024-04-25T13:17:39.607821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.607720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.607720+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.607720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:19.112454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.588371+0000","last_change":"2024-04-25T13:17:37.588427+0000","last_active":"2024-04-25T13:17:37.588371+0000","last_peered":"2024-04-25T13:17:37.588371+0000","last_clean":"2024-04-25T13:17:37.588371+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:17:37.588371+0000","last_undegraded":"2024-04-25T13:17:37.588371+0000","last_fullsized":"2024-04-25T13:17:37.588371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.588232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.588232+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.588232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:21.299827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.126400+0000","last_change":"2024-04-25T13:17:35.126432+0000","last_active":"2024-04-25T13:17:35.126400+0000","last_peered":"2024-04-25T13:17:35.126400+0000","last_clean":"2024-04-25T13:17:35.126400+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:17:35.126400+0000","last_undegraded":"2024-04-25T13:17:35.126400+0000","last_fullsized":"2024-04-25T13:17:35.126400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:35.126320+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:35.126320+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.126320+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:31.765459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.611072+0000","last_change":"2024-04-25T13:17:36.611097+0000","last_active":"2024-04-25T13:17:36.611072+0000","last_peered":"2024-04-25T13:17:36.611072+0000","last_clean":"2024-04-25T13:17:36.611072+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:17:36.611072+0000","last_undegraded":"2024-04-25T13:17:36.611072+0000","last_fullsized":"2024-04-25T13:17:36.611072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.610966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.610966+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.610966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:12.072905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.273959+0000","last_change":"2024-04-25T13:17:34.274015+0000","last_active":"2024-04-25T13:17:34.273959+0000","last_peered":"2024-04-25T13:17:34.273959+0000","last_clean":"2024-04-25T13:17:34.273959+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:17:34.273959+0000","last_undegraded":"2024-04-25T13:17:34.273959+0000","last_fullsized":"2024-04-25T13:17:34.273959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.273852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.273852+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.273852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:07.559111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.077532+0000","last_change":"2024-04-25T13:17:29.077578+0000","last_active":"2024-04-25T13:17:29.077532+0000","last_peered":"2024-04-25T13:17:29.077532+0000","last_clean":"2024-04-25T13:17:29.077532+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:17:29.077532+0000","last_undegraded":"2024-04-25T13:17:29.077532+0000","last_fullsized":"2024-04-25T13:17:29.077532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:29.077432+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:29.077432+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.077432+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:04.638589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.584363+0000","last_change":"2024-04-25T13:17:42.584396+0000","last_active":"2024-04-25T13:17:42.584363+0000","last_peered":"2024-04-25T13:17:42.584363+0000","last_clean":"2024-04-25T13:17:42.584363+0000","last_became_active":"2024-04-25T13:16:50.369812+0000","last_became_peered":"2024-04-25T13:16:50.369812+0000","last_unstale":"2024-04-25T13:17:42.584363+0000","last_undegraded":"2024-04-25T13:17:42.584363+0000","last_fullsized":"2024-04-25T13:17:42.584363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.584270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.584270+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.584270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:00.550128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.255907+0000","last_change":"2024-04-25T13:17:35.255954+0000","last_active":"2024-04-25T13:17:35.255907+0000","last_peered":"2024-04-25T13:17:35.255907+0000","last_clean":"2024-04-25T13:17:35.255907+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:17:35.255907+0000","last_undegraded":"2024-04-25T13:17:35.255907+0000","last_fullsized":"2024-04-25T13:17:35.255907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.255816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.255816+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.255816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:18.891438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.122653+0000","last_change":"2024-04-25T13:17:30.122688+0000","last_active":"2024-04-25T13:17:30.122653+0000","last_peered":"2024-04-25T13:17:30.122653+0000","last_clean":"2024-04-25T13:17:30.122653+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:17:30.122653+0000","last_undegraded":"2024-04-25T13:17:30.122653+0000","last_fullsized":"2024-04-25T13:17:30.122653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T13:17:30.122564+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T13:17:30.122564+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.122564+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:55.870044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.195308+0000","last_change":"2024-04-25T13:17:43.195338+0000","last_active":"2024-04-25T13:17:43.195308+0000","last_peered":"2024-04-25T13:17:43.195308+0000","last_clean":"2024-04-25T13:17:43.195308+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:17:43.195308+0000","last_undegraded":"2024-04-25T13:17:43.195308+0000","last_fullsized":"2024-04-25T13:17:43.195308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.195225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.195225+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.195225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:09.185333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.569073+0000","last_change":"2024-04-25T13:17:29.569098+0000","last_active":"2024-04-25T13:17:29.569073+0000","last_peered":"2024-04-25T13:17:29.569073+0000","last_clean":"2024-04-25T13:17:29.569073+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:17:29.569073+0000","last_undegraded":"2024-04-25T13:17:29.569073+0000","last_fullsized":"2024-04-25T13:17:29.569073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.568975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.568975+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.568975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:56.898866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.128035+0000","last_change":"2024-04-25T13:17:33.128066+0000","last_active":"2024-04-25T13:17:33.128035+0000","last_peered":"2024-04-25T13:17:33.128035+0000","last_clean":"2024-04-25T13:17:33.128035+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:17:33.128035+0000","last_undegraded":"2024-04-25T13:17:33.128035+0000","last_fullsized":"2024-04-25T13:17:33.128035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-25T13:17:33.127947+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-25T13:17:33.127947+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.127947+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:24.609183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.651947+0000","last_change":"2024-04-25T13:17:40.651977+0000","last_active":"2024-04-25T13:17:40.651947+0000","last_peered":"2024-04-25T13:17:40.651947+0000","last_clean":"2024-04-25T13:17:40.651947+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:17:40.651947+0000","last_undegraded":"2024-04-25T13:17:40.651947+0000","last_fullsized":"2024-04-25T13:17:40.651947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.651823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.651823+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.651823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:36.327868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.616326+0000","last_change":"2024-04-25T13:17:33.616352+0000","last_active":"2024-04-25T13:17:33.616326+0000","last_peered":"2024-04-25T13:17:33.616326+0000","last_clean":"2024-04-25T13:17:33.616326+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:17:33.616326+0000","last_undegraded":"2024-04-25T13:17:33.616326+0000","last_fullsized":"2024-04-25T13:17:33.616326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.616232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.616232+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.616232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:45.264232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.545246+0000","last_change":"2024-04-25T13:17:33.545285+0000","last_active":"2024-04-25T13:17:33.545246+0000","last_peered":"2024-04-25T13:17:33.545246+0000","last_clean":"2024-04-25T13:17:33.545246+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:17:33.545246+0000","last_undegraded":"2024-04-25T13:17:33.545246+0000","last_fullsized":"2024-04-25T13:17:33.545246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-25T13:17:33.545144+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-25T13:17:33.545144+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.545144+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:08.278257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.653693+0000","last_change":"2024-04-25T13:17:35.653722+0000","last_active":"2024-04-25T13:17:35.653693+0000","last_peered":"2024-04-25T13:17:35.653693+0000","last_clean":"2024-04-25T13:17:35.653693+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:17:35.653693+0000","last_undegraded":"2024-04-25T13:17:35.653693+0000","last_fullsized":"2024-04-25T13:17:35.653693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.653590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.653590+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.653590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:07.477423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.297522+0000","last_change":"2024-04-25T13:17:38.297547+0000","last_active":"2024-04-25T13:17:38.297522+0000","last_peered":"2024-04-25T13:17:38.297522+0000","last_clean":"2024-04-25T13:17:38.297522+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:17:38.297522+0000","last_undegraded":"2024-04-25T13:17:38.297522+0000","last_fullsized":"2024-04-25T13:17:38.297522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.297433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.297433+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.297433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:20.416292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.054252+0000","last_change":"2024-04-25T13:17:33.054289+0000","last_active":"2024-04-25T13:17:33.054252+0000","last_peered":"2024-04-25T13:17:33.054252+0000","last_clean":"2024-04-25T13:17:33.054252+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:17:33.054252+0000","last_undegraded":"2024-04-25T13:17:33.054252+0000","last_fullsized":"2024-04-25T13:17:33.054252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-25T13:17:33.054144+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-25T13:17:33.054144+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.054144+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:08.477157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.352129+0000","last_change":"2024-04-25T13:17:43.352182+0000","last_active":"2024-04-25T13:17:43.352129+0000","last_peered":"2024-04-25T13:17:43.352129+0000","last_clean":"2024-04-25T13:17:43.352129+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:17:43.352129+0000","last_undegraded":"2024-04-25T13:17:43.352129+0000","last_fullsized":"2024-04-25T13:17:43.352129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.352024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.352024+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.352024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:14.229960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.087977+0000","last_change":"2024-04-25T13:17:27.087999+0000","last_active":"2024-04-25T13:17:27.087977+0000","last_peered":"2024-04-25T13:17:27.087977+0000","last_clean":"2024-04-25T13:17:27.087977+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:17:27.087977+0000","last_undegraded":"2024-04-25T13:17:27.087977+0000","last_fullsized":"2024-04-25T13:17:27.087977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.087901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.087901+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.087901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:48.021675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.098392+0000","last_change":"2024-04-25T13:17:36.098428+0000","last_active":"2024-04-25T13:17:36.098392+0000","last_peered":"2024-04-25T13:17:36.098392+0000","last_clean":"2024-04-25T13:17:36.098392+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:17:36.098392+0000","last_undegraded":"2024-04-25T13:17:36.098392+0000","last_fullsized":"2024-04-25T13:17:36.098392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:36.098296+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:36.098296+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.098296+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:12.838478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.768332+0000","last_change":"2024-04-25T13:17:41.768357+0000","last_active":"2024-04-25T13:17:41.768332+0000","last_peered":"2024-04-25T13:17:41.768332+0000","last_clean":"2024-04-25T13:17:41.768332+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:17:41.768332+0000","last_undegraded":"2024-04-25T13:17:41.768332+0000","last_fullsized":"2024-04-25T13:17:41.768332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.768245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.768245+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.768245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:02.897428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.239020+0000","last_change":"2024-04-25T13:17:39.239052+0000","last_active":"2024-04-25T13:17:39.239020+0000","last_peered":"2024-04-25T13:17:39.239020+0000","last_clean":"2024-04-25T13:17:39.239020+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:17:39.239020+0000","last_undegraded":"2024-04-25T13:17:39.239020+0000","last_fullsized":"2024-04-25T13:17:39.239020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.238893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.238893+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.238893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:25.981387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.086138+0000","last_change":"2024-04-25T13:17:31.086176+0000","last_active":"2024-04-25T13:17:31.086138+0000","last_peered":"2024-04-25T13:17:31.086138+0000","last_clean":"2024-04-25T13:17:31.086138+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:17:31.086138+0000","last_undegraded":"2024-04-25T13:17:31.086138+0000","last_fullsized":"2024-04-25T13:17:31.086138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-25T13:17:31.086046+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-25T13:17:31.086046+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.086046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.325190+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.127749+0000","last_change":"2024-04-25T13:17:39.127802+0000","last_active":"2024-04-25T13:17:39.127749+0000","last_peered":"2024-04-25T13:17:39.127749+0000","last_clean":"2024-04-25T13:17:39.127749+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:17:39.127749+0000","last_undegraded":"2024-04-25T13:17:39.127749+0000","last_fullsized":"2024-04-25T13:17:39.127749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.127648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.127648+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.127648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:55.352540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.618082+0000","last_change":"2024-04-25T13:17:33.618120+0000","last_active":"2024-04-25T13:17:33.618082+0000","last_peered":"2024-04-25T13:17:33.618082+0000","last_clean":"2024-04-25T13:17:33.618082+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:17:33.618082+0000","last_undegraded":"2024-04-25T13:17:33.618082+0000","last_fullsized":"2024-04-25T13:17:33.618082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.617974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.617974+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.617974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:09.916315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.358605+0000","last_change":"2024-04-25T13:17:33.358663+0000","last_active":"2024-04-25T13:17:33.358605+0000","last_peered":"2024-04-25T13:17:33.358605+0000","last_clean":"2024-04-25T13:17:33.358605+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:17:33.358605+0000","last_undegraded":"2024-04-25T13:17:33.358605+0000","last_fullsized":"2024-04-25T13:17:33.358605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:33.358487+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:33.358487+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.358487+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:59.123917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.156031+0000","last_change":"2024-04-25T13:17:41.156057+0000","last_active":"2024-04-25T13:17:41.156031+0000","last_peered":"2024-04-25T13:17:41.156031+0000","last_clean":"2024-04-25T13:17:41.156031+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:17:41.156031+0000","last_undegraded":"2024-04-25T13:17:41.156031+0000","last_fullsized":"2024-04-25T13:17:41.156031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.155934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.155934+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.155934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:27.406539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.016130+0000","last_change":"2024-04-25T13:17:34.016152+0000","last_active":"2024-04-25T13:17:34.016130+0000","last_peered":"2024-04-25T13:17:34.016130+0000","last_clean":"2024-04-25T13:17:34.016130+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:17:34.016130+0000","last_undegraded":"2024-04-25T13:17:34.016130+0000","last_fullsized":"2024-04-25T13:17:34.016130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.016033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.016033+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.016033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:34.556021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.439885+0000","last_change":"2024-04-25T13:17:27.439912+0000","last_active":"2024-04-25T13:17:27.439885+0000","last_peered":"2024-04-25T13:17:27.439885+0000","last_clean":"2024-04-25T13:17:27.439885+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:17:27.439885+0000","last_undegraded":"2024-04-25T13:17:27.439885+0000","last_fullsized":"2024-04-25T13:17:27.439885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:27.439809+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:27.439809+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.439809+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:05.079552+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.204494+0000","last_change":"2024-04-25T13:17:42.204555+0000","last_active":"2024-04-25T13:17:42.204494+0000","last_peered":"2024-04-25T13:17:42.204494+0000","last_clean":"2024-04-25T13:17:42.204494+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:17:42.204494+0000","last_undegraded":"2024-04-25T13:17:42.204494+0000","last_fullsized":"2024-04-25T13:17:42.204494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.204389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.204389+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.204389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:57.921440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.645710+0000","last_change":"2024-04-25T13:17:31.645735+0000","last_active":"2024-04-25T13:17:31.645710+0000","last_peered":"2024-04-25T13:17:31.645710+0000","last_clean":"2024-04-25T13:17:31.645710+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:17:31.645710+0000","last_undegraded":"2024-04-25T13:17:31.645710+0000","last_fullsized":"2024-04-25T13:17:31.645710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.645597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.645597+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.645597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:01.153298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.161767+0000","last_change":"2024-04-25T13:17:34.161802+0000","last_active":"2024-04-25T13:17:34.161767+0000","last_peered":"2024-04-25T13:17:34.161767+0000","last_clean":"2024-04-25T13:17:34.161767+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:17:34.161767+0000","last_undegraded":"2024-04-25T13:17:34.161767+0000","last_fullsized":"2024-04-25T13:17:34.161767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T13:17:34.161684+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T13:17:34.161684+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.161684+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:05.102733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.759193+0000","last_change":"2024-04-25T13:17:39.759219+0000","last_active":"2024-04-25T13:17:39.759193+0000","last_peered":"2024-04-25T13:17:39.759193+0000","last_clean":"2024-04-25T13:17:39.759193+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:17:39.759193+0000","last_undegraded":"2024-04-25T13:17:39.759193+0000","last_fullsized":"2024-04-25T13:17:39.759193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.759102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.759102+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.759102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:02.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.375157+0000","last_change":"2024-04-25T13:16:50.373995+0000","last_active":"2024-04-25T13:16:50.375157+0000","last_peered":"2024-04-25T13:16:50.375157+0000","last_clean":"2024-04-25T13:16:50.375157+0000","last_became_active":"2024-04-25T13:16:50.373669+0000","last_became_peered":"2024-04-25T13:16:50.373669+0000","last_unstale":"2024-04-25T13:16:50.375157+0000","last_undegraded":"2024-04-25T13:16:50.375157+0000","last_fullsized":"2024-04-25T13:16:50.375157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.360716+0000","last_change":"2024-04-25T13:17:32.360756+0000","last_active":"2024-04-25T13:17:32.360716+0000","last_peered":"2024-04-25T13:17:32.360716+0000","last_clean":"2024-04-25T13:17:32.360716+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:17:32.360716+0000","last_undegraded":"2024-04-25T13:17:32.360716+0000","last_fullsized":"2024-04-25T13:17:32.360716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T13:17:32.360638+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T13:17:32.360638+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.360638+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:56.219989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.177859+0000","last_change":"2024-04-25T13:17:31.177891+0000","last_active":"2024-04-25T13:17:31.177859+0000","last_peered":"2024-04-25T13:17:31.177859+0000","last_clean":"2024-04-25T13:17:31.177859+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:17:31.177859+0000","last_undegraded":"2024-04-25T13:17:31.177859+0000","last_fullsized":"2024-04-25T13:17:31.177859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-25T13:17:31.177776+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-25T13:17:31.177776+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.177776+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.891107+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.727319+0000","last_change":"2024-04-25T13:17:42.727349+0000","last_active":"2024-04-25T13:17:42.727319+0000","last_peered":"2024-04-25T13:17:42.727319+0000","last_clean":"2024-04-25T13:17:42.727319+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:17:42.727319+0000","last_undegraded":"2024-04-25T13:17:42.727319+0000","last_fullsized":"2024-04-25T13:17:42.727319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.727210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.727210+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.727210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:11.092783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.366377+0000","last_change":"2024-04-25T13:16:50.365712+0000","last_active":"2024-04-25T13:16:50.366377+0000","last_peered":"2024-04-25T13:16:50.366377+0000","last_clean":"2024-04-25T13:16:50.366377+0000","last_became_active":"2024-04-25T13:16:50.365465+0000","last_became_peered":"2024-04-25T13:16:50.365465+0000","last_unstale":"2024-04-25T13:16:50.366377+0000","last_undegraded":"2024-04-25T13:16:50.366377+0000","last_fullsized":"2024-04-25T13:16:50.366377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:09.203474+0000","last_clean_scrub_stamp":"2024-04-25T13:16:09.203474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.390489+0000","last_change":"2024-04-25T13:17:30.390519+0000","last_active":"2024-04-25T13:17:30.390489+0000","last_peered":"2024-04-25T13:17:30.390489+0000","last_clean":"2024-04-25T13:17:30.390489+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:17:30.390489+0000","last_undegraded":"2024-04-25T13:17:30.390489+0000","last_fullsized":"2024-04-25T13:17:30.390489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T13:17:30.390410+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T13:17:30.390410+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.390410+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:33.829243+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.691747+0000","last_change":"2024-04-25T13:17:43.691774+0000","last_active":"2024-04-25T13:17:43.691747+0000","last_peered":"2024-04-25T13:17:43.691747+0000","last_clean":"2024-04-25T13:17:43.691747+0000","last_became_active":"2024-04-25T13:16:50.368538+0000","last_became_peered":"2024-04-25T13:16:50.368538+0000","last_unstale":"2024-04-25T13:17:43.691747+0000","last_undegraded":"2024-04-25T13:17:43.691747+0000","last_fullsized":"2024-04-25T13:17:43.691747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.691657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.691657+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.691657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:44.953828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.338865+0000","last_change":"2024-04-25T13:17:29.338891+0000","last_active":"2024-04-25T13:17:29.338865+0000","last_peered":"2024-04-25T13:17:29.338865+0000","last_clean":"2024-04-25T13:17:29.338865+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:17:29.338865+0000","last_undegraded":"2024-04-25T13:17:29.338865+0000","last_fullsized":"2024-04-25T13:17:29.338865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.338784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.338784+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.338784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:30.067038+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.085601+0000","last_change":"2024-04-25T13:17:28.085632+0000","last_active":"2024-04-25T13:17:28.085601+0000","last_peered":"2024-04-25T13:17:28.085601+0000","last_clean":"2024-04-25T13:17:28.085601+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:17:28.085601+0000","last_undegraded":"2024-04-25T13:17:28.085601+0000","last_fullsized":"2024-04-25T13:17:28.085601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:28.085527+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:28.085527+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.085527+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:36.689003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.793142+0000","last_change":"2024-04-25T13:17:42.793187+0000","last_active":"2024-04-25T13:17:42.793142+0000","last_peered":"2024-04-25T13:17:42.793142+0000","last_clean":"2024-04-25T13:17:42.793142+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:17:42.793142+0000","last_undegraded":"2024-04-25T13:17:42.793142+0000","last_fullsized":"2024-04-25T13:17:42.793142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.793018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.793018+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.793018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:23.367969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.140273+0000","last_change":"2024-04-25T13:17:44.140296+0000","last_active":"2024-04-25T13:17:44.140273+0000","last_peered":"2024-04-25T13:17:44.140273+0000","last_clean":"2024-04-25T13:17:44.140273+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:17:44.140273+0000","last_undegraded":"2024-04-25T13:17:44.140273+0000","last_fullsized":"2024-04-25T13:17:44.140273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.140190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.140190+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.140190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:50.177105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.424692+0000","last_change":"2024-04-25T13:17:29.424717+0000","last_active":"2024-04-25T13:17:29.424692+0000","last_peered":"2024-04-25T13:17:29.424692+0000","last_clean":"2024-04-25T13:17:29.424692+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:17:29.424692+0000","last_undegraded":"2024-04-25T13:17:29.424692+0000","last_fullsized":"2024-04-25T13:17:29.424692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:29.424615+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:29.424615+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.424615+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:23.849874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.144331+0000","last_change":"2024-04-25T13:17:45.144375+0000","last_active":"2024-04-25T13:17:45.144331+0000","last_peered":"2024-04-25T13:17:45.144331+0000","last_clean":"2024-04-25T13:17:45.144331+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:17:45.144331+0000","last_undegraded":"2024-04-25T13:17:45.144331+0000","last_fullsized":"2024-04-25T13:17:45.144331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.144217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.144217+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.144217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:52.381740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.170277+0000","last_change":"2024-04-25T13:17:43.170326+0000","last_active":"2024-04-25T13:17:43.170277+0000","last_peered":"2024-04-25T13:17:43.170277+0000","last_clean":"2024-04-25T13:17:43.170277+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:17:43.170277+0000","last_undegraded":"2024-04-25T13:17:43.170277+0000","last_fullsized":"2024-04-25T13:17:43.170277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.170178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.170178+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.170178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:54.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.532892+0000","last_change":"2024-04-25T13:17:28.532949+0000","last_active":"2024-04-25T13:17:28.532892+0000","last_peered":"2024-04-25T13:17:28.532892+0000","last_clean":"2024-04-25T13:17:28.532892+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:17:28.532892+0000","last_undegraded":"2024-04-25T13:17:28.532892+0000","last_fullsized":"2024-04-25T13:17:28.532892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:28.532796+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:28.532796+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.532796+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:55.384261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.613945+0000","last_change":"2024-04-25T13:17:38.613973+0000","last_active":"2024-04-25T13:17:38.613945+0000","last_peered":"2024-04-25T13:17:38.613945+0000","last_clean":"2024-04-25T13:17:38.613945+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:17:38.613945+0000","last_undegraded":"2024-04-25T13:17:38.613945+0000","last_fullsized":"2024-04-25T13:17:38.613945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.613857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.613857+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.613857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:47.182579+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.185878+0000","last_change":"2024-04-25T13:17:42.185918+0000","last_active":"2024-04-25T13:17:42.185878+0000","last_peered":"2024-04-25T13:17:42.185878+0000","last_clean":"2024-04-25T13:17:42.185878+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:17:42.185878+0000","last_undegraded":"2024-04-25T13:17:42.185878+0000","last_fullsized":"2024-04-25T13:17:42.185878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.185743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.185743+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.185743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:53.673307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'25","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.420765+0000","last_change":"2024-04-25T13:17:28.420807+0000","last_active":"2024-04-25T13:17:28.420765+0000","last_peered":"2024-04-25T13:17:28.420765+0000","last_clean":"2024-04-25T13:17:28.420765+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:17:28.420765+0000","last_undegraded":"2024-04-25T13:17:28.420765+0000","last_fullsized":"2024-04-25T13:17:28.420765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-25T13:17:28.420700+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-25T13:17:28.420700+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.420700+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:01.959645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.747861+0000","last_change":"2024-04-25T13:17:38.747891+0000","last_active":"2024-04-25T13:17:38.747861+0000","last_peered":"2024-04-25T13:17:38.747861+0000","last_clean":"2024-04-25T13:17:38.747861+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:17:38.747861+0000","last_undegraded":"2024-04-25T13:17:38.747861+0000","last_fullsized":"2024-04-25T13:17:38.747861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.747770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.747770+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.747770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:31.202218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.581354+0000","last_change":"2024-04-25T13:17:34.581377+0000","last_active":"2024-04-25T13:17:34.581354+0000","last_peered":"2024-04-25T13:17:34.581354+0000","last_clean":"2024-04-25T13:17:34.581354+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:17:34.581354+0000","last_undegraded":"2024-04-25T13:17:34.581354+0000","last_fullsized":"2024-04-25T13:17:34.581354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.581266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.581266+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.581266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:52.531392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.538658+0000","last_change":"2024-04-25T13:17:30.538692+0000","last_active":"2024-04-25T13:17:30.538658+0000","last_peered":"2024-04-25T13:17:30.538658+0000","last_clean":"2024-04-25T13:17:30.538658+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:17:30.538658+0000","last_undegraded":"2024-04-25T13:17:30.538658+0000","last_fullsized":"2024-04-25T13:17:30.538658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T13:17:30.538556+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T13:17:30.538556+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.538556+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:43.626190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.397972+0000","last_change":"2024-04-25T13:17:41.397998+0000","last_active":"2024-04-25T13:17:41.397972+0000","last_peered":"2024-04-25T13:17:41.397972+0000","last_clean":"2024-04-25T13:17:41.397972+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:17:41.397972+0000","last_undegraded":"2024-04-25T13:17:41.397972+0000","last_fullsized":"2024-04-25T13:17:41.397972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.397868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.397868+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.397868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:31.925761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.143415+0000","last_change":"2024-04-25T13:17:41.143443+0000","last_active":"2024-04-25T13:17:41.143415+0000","last_peered":"2024-04-25T13:17:41.143415+0000","last_clean":"2024-04-25T13:17:41.143415+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:17:41.143415+0000","last_undegraded":"2024-04-25T13:17:41.143415+0000","last_fullsized":"2024-04-25T13:17:41.143415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.143308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.143308+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.143308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:36.376309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.352851+0000","last_change":"2024-04-25T13:17:34.352894+0000","last_active":"2024-04-25T13:17:34.352851+0000","last_peered":"2024-04-25T13:17:34.352851+0000","last_clean":"2024-04-25T13:17:34.352851+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:17:34.352851+0000","last_undegraded":"2024-04-25T13:17:34.352851+0000","last_fullsized":"2024-04-25T13:17:34.352851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T13:17:34.352770+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T13:17:34.352770+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.352770+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:50.774058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.388869+0000","last_change":"2024-04-25T13:17:40.388915+0000","last_active":"2024-04-25T13:17:40.388869+0000","last_peered":"2024-04-25T13:17:40.388869+0000","last_clean":"2024-04-25T13:17:40.388869+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:17:40.388869+0000","last_undegraded":"2024-04-25T13:17:40.388869+0000","last_fullsized":"2024-04-25T13:17:40.388869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.388772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.388772+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.388772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:04.338463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.675401+0000","last_change":"2024-04-25T13:17:30.675426+0000","last_active":"2024-04-25T13:17:30.675401+0000","last_peered":"2024-04-25T13:17:30.675401+0000","last_clean":"2024-04-25T13:17:30.675401+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:17:30.675401+0000","last_undegraded":"2024-04-25T13:17:30.675401+0000","last_fullsized":"2024-04-25T13:17:30.675401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.675321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.675321+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.675321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:41.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'14","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.698564+0000","last_change":"2024-04-25T13:17:27.698594+0000","last_active":"2024-04-25T13:17:27.698564+0000","last_peered":"2024-04-25T13:17:27.698564+0000","last_clean":"2024-04-25T13:17:27.698564+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:17:27.698564+0000","last_undegraded":"2024-04-25T13:17:27.698564+0000","last_fullsized":"2024-04-25T13:17:27.698564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-04-25T13:17:27.698501+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-04-25T13:17:27.698501+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.698501+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:41.724475+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:16:50.368420+0000","last_change":"2024-04-25T13:16:14.267059+0000","last_active":"2024-04-25T13:16:50.368420+0000","last_peered":"2024-04-25T13:16:50.368420+0000","last_clean":"2024-04-25T13:16:50.368420+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:16:50.368420+0000","last_undegraded":"2024-04-25T13:16:50.368420+0000","last_fullsized":"2024-04-25T13:16:50.368420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:13.225464+0000","last_clean_scrub_stamp":"2024-04-25T13:16:13.225464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.094536+0000","last_change":"2024-04-25T13:17:40.094558+0000","last_active":"2024-04-25T13:17:40.094536+0000","last_peered":"2024-04-25T13:17:40.094536+0000","last_clean":"2024-04-25T13:17:40.094536+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:17:40.094536+0000","last_undegraded":"2024-04-25T13:17:40.094536+0000","last_fullsized":"2024-04-25T13:17:40.094536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.094439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.094439+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.094439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:55.391299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'20","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.520175+0000","last_change":"2024-04-25T13:17:29.520214+0000","last_active":"2024-04-25T13:17:29.520175+0000","last_peered":"2024-04-25T13:17:29.520175+0000","last_clean":"2024-04-25T13:17:29.520175+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:17:29.520175+0000","last_undegraded":"2024-04-25T13:17:29.520175+0000","last_fullsized":"2024-04-25T13:17:29.520175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-25T13:17:29.520071+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-25T13:17:29.520071+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.520071+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.505888+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.153986+0000","last_change":"2024-04-25T13:17:40.154030+0000","last_active":"2024-04-25T13:17:40.153986+0000","last_peered":"2024-04-25T13:17:40.153986+0000","last_clean":"2024-04-25T13:17:40.153986+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:17:40.153986+0000","last_undegraded":"2024-04-25T13:17:40.153986+0000","last_fullsized":"2024-04-25T13:17:40.153986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.153859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.153859+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.153859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:00.078915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.642220+0000","last_change":"2024-04-25T13:17:31.642248+0000","last_active":"2024-04-25T13:17:31.642220+0000","last_peered":"2024-04-25T13:17:31.642220+0000","last_clean":"2024-04-25T13:17:31.642220+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:17:31.642220+0000","last_undegraded":"2024-04-25T13:17:31.642220+0000","last_fullsized":"2024-04-25T13:17:31.642220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.642129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.642129+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.642129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:31.887393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.055478+0000","last_change":"2024-04-25T13:17:32.055513+0000","last_active":"2024-04-25T13:17:32.055478+0000","last_peered":"2024-04-25T13:17:32.055478+0000","last_clean":"2024-04-25T13:17:32.055478+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:17:32.055478+0000","last_undegraded":"2024-04-25T13:17:32.055478+0000","last_fullsized":"2024-04-25T13:17:32.055478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T13:17:32.055395+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T13:17:32.055395+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.055395+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:11.577858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.634038+0000","last_change":"2024-04-25T13:17:34.634069+0000","last_active":"2024-04-25T13:17:34.634038+0000","last_peered":"2024-04-25T13:17:34.634038+0000","last_clean":"2024-04-25T13:17:34.634038+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:17:34.634038+0000","last_undegraded":"2024-04-25T13:17:34.634038+0000","last_fullsized":"2024-04-25T13:17:34.634038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.633930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.633930+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.633930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:39.391072+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.713033+0000","last_change":"2024-04-25T13:17:36.713055+0000","last_active":"2024-04-25T13:17:36.713033+0000","last_peered":"2024-04-25T13:17:36.713033+0000","last_clean":"2024-04-25T13:17:36.713033+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:17:36.713033+0000","last_undegraded":"2024-04-25T13:17:36.713033+0000","last_fullsized":"2024-04-25T13:17:36.713033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.712949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.712949+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.712949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:31.805066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.374832+0000","last_change":"2024-04-25T13:17:35.374868+0000","last_active":"2024-04-25T13:17:35.374832+0000","last_peered":"2024-04-25T13:17:35.374832+0000","last_clean":"2024-04-25T13:17:35.374832+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:17:35.374832+0000","last_undegraded":"2024-04-25T13:17:35.374832+0000","last_fullsized":"2024-04-25T13:17:35.374832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:35.374748+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:35.374748+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.374748+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:02.226212+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.311312+0000","last_change":"2024-04-25T13:17:44.311343+0000","last_active":"2024-04-25T13:17:44.311312+0000","last_peered":"2024-04-25T13:17:44.311312+0000","last_clean":"2024-04-25T13:17:44.311312+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:17:44.311312+0000","last_undegraded":"2024-04-25T13:17:44.311312+0000","last_fullsized":"2024-04-25T13:17:44.311312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.311218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.311218+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.311218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:45.799961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.186962+0000","last_change":"2024-04-25T13:17:42.186986+0000","last_active":"2024-04-25T13:17:42.186962+0000","last_peered":"2024-04-25T13:17:42.186962+0000","last_clean":"2024-04-25T13:17:42.186962+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:17:42.186962+0000","last_undegraded":"2024-04-25T13:17:42.186962+0000","last_fullsized":"2024-04-25T13:17:42.186962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.186885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.186885+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.186885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:07.144530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.500832+0000","last_change":"2024-04-25T13:17:32.500864+0000","last_active":"2024-04-25T13:17:32.500832+0000","last_peered":"2024-04-25T13:17:32.500832+0000","last_clean":"2024-04-25T13:17:32.500832+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:17:32.500832+0000","last_undegraded":"2024-04-25T13:17:32.500832+0000","last_fullsized":"2024-04-25T13:17:32.500832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:32.500734+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:32.500734+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.500734+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:20.591471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.367045+0000","last_change":"2024-04-25T13:17:42.367074+0000","last_active":"2024-04-25T13:17:42.367045+0000","last_peered":"2024-04-25T13:17:42.367045+0000","last_clean":"2024-04-25T13:17:42.367045+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:17:42.367045+0000","last_undegraded":"2024-04-25T13:17:42.367045+0000","last_fullsized":"2024-04-25T13:17:42.367045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.366953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.366953+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.366953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:31.913857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.731190+0000","last_change":"2024-04-25T13:17:40.731220+0000","last_active":"2024-04-25T13:17:40.731190+0000","last_peered":"2024-04-25T13:17:40.731190+0000","last_clean":"2024-04-25T13:17:40.731190+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:17:40.731190+0000","last_undegraded":"2024-04-25T13:17:40.731190+0000","last_fullsized":"2024-04-25T13:17:40.731190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.731099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.731099+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.731099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:17.590493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.096359+0000","last_change":"2024-04-25T13:17:37.096397+0000","last_active":"2024-04-25T13:17:37.096359+0000","last_peered":"2024-04-25T13:17:37.096359+0000","last_clean":"2024-04-25T13:17:37.096359+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:17:37.096359+0000","last_undegraded":"2024-04-25T13:17:37.096359+0000","last_fullsized":"2024-04-25T13:17:37.096359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.096237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.096237+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.096237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:07.866051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.352773+0000","last_change":"2024-04-25T13:17:31.352800+0000","last_active":"2024-04-25T13:17:31.352773+0000","last_peered":"2024-04-25T13:17:31.352773+0000","last_clean":"2024-04-25T13:17:31.352773+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:17:31.352773+0000","last_undegraded":"2024-04-25T13:17:31.352773+0000","last_fullsized":"2024-04-25T13:17:31.352773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:31.352688+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:31.352688+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.352688+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:34.013004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.710089+0000","last_change":"2024-04-25T13:17:41.710114+0000","last_active":"2024-04-25T13:17:41.710089+0000","last_peered":"2024-04-25T13:17:41.710089+0000","last_clean":"2024-04-25T13:17:41.710089+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:17:41.710089+0000","last_undegraded":"2024-04-25T13:17:41.710089+0000","last_fullsized":"2024-04-25T13:17:41.710089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.710002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.710002+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.710002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:31.147852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.345816+0000","last_change":"2024-04-25T13:17:36.345853+0000","last_active":"2024-04-25T13:17:36.345816+0000","last_peered":"2024-04-25T13:17:36.345816+0000","last_clean":"2024-04-25T13:17:36.345816+0000","last_became_active":"2024-04-25T13:16:50.370143+0000","last_became_peered":"2024-04-25T13:16:50.370143+0000","last_unstale":"2024-04-25T13:17:36.345816+0000","last_undegraded":"2024-04-25T13:17:36.345816+0000","last_fullsized":"2024-04-25T13:17:36.345816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.345678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.345678+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.345678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:38.072783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.322276+0000","last_change":"2024-04-25T13:17:33.322323+0000","last_active":"2024-04-25T13:17:33.322276+0000","last_peered":"2024-04-25T13:17:33.322276+0000","last_clean":"2024-04-25T13:17:33.322276+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:17:33.322276+0000","last_undegraded":"2024-04-25T13:17:33.322276+0000","last_fullsized":"2024-04-25T13:17:33.322276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T13:17:33.322197+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T13:17:33.322197+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.322197+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.135059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.507889+0000","last_change":"2024-04-25T13:17:31.507923+0000","last_active":"2024-04-25T13:17:31.507889+0000","last_peered":"2024-04-25T13:17:31.507889+0000","last_clean":"2024-04-25T13:17:31.507889+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:17:31.507889+0000","last_undegraded":"2024-04-25T13:17:31.507889+0000","last_fullsized":"2024-04-25T13:17:31.507889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T13:17:31.507809+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T13:17:31.507809+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.507809+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.450513+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.689088+0000","last_change":"2024-04-25T13:17:35.689116+0000","last_active":"2024-04-25T13:17:35.689088+0000","last_peered":"2024-04-25T13:17:35.689088+0000","last_clean":"2024-04-25T13:17:35.689088+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:17:35.689088+0000","last_undegraded":"2024-04-25T13:17:35.689088+0000","last_fullsized":"2024-04-25T13:17:35.689088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.688996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.688996+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.688996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:08.072465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.407035+0000","last_change":"2024-04-25T13:17:33.407063+0000","last_active":"2024-04-25T13:17:33.407035+0000","last_peered":"2024-04-25T13:17:33.407035+0000","last_clean":"2024-04-25T13:17:33.407035+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:17:33.407035+0000","last_undegraded":"2024-04-25T13:17:33.407035+0000","last_fullsized":"2024-04-25T13:17:33.407035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.406948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.406948+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.406948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:02.397854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.272687+0000","last_change":"2024-04-25T13:17:32.272726+0000","last_active":"2024-04-25T13:17:32.272687+0000","last_peered":"2024-04-25T13:17:32.272687+0000","last_clean":"2024-04-25T13:17:32.272687+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:17:32.272687+0000","last_undegraded":"2024-04-25T13:17:32.272687+0000","last_fullsized":"2024-04-25T13:17:32.272687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T13:17:32.272591+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T13:17:32.272591+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.272591+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:22.929964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.611060+0000","last_change":"2024-04-25T13:17:30.611105+0000","last_active":"2024-04-25T13:17:30.611060+0000","last_peered":"2024-04-25T13:17:30.611060+0000","last_clean":"2024-04-25T13:17:30.611060+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:17:30.611060+0000","last_undegraded":"2024-04-25T13:17:30.611060+0000","last_fullsized":"2024-04-25T13:17:30.611060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.610965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.610965+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.610965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:52.713413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.301661+0000","last_change":"2024-04-25T13:17:45.301705+0000","last_active":"2024-04-25T13:17:45.301661+0000","last_peered":"2024-04-25T13:17:45.301661+0000","last_clean":"2024-04-25T13:17:45.301661+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:17:45.301661+0000","last_undegraded":"2024-04-25T13:17:45.301661+0000","last_fullsized":"2024-04-25T13:17:45.301661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.301543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.301543+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.301543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:35.098910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.571885+0000","last_change":"2024-04-25T13:17:35.571922+0000","last_active":"2024-04-25T13:17:35.571885+0000","last_peered":"2024-04-25T13:17:35.571885+0000","last_clean":"2024-04-25T13:17:35.571885+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:17:35.571885+0000","last_undegraded":"2024-04-25T13:17:35.571885+0000","last_fullsized":"2024-04-25T13:17:35.571885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.571780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.571780+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.571780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:06.362005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.389459+0000","last_change":"2024-04-25T13:17:32.389484+0000","last_active":"2024-04-25T13:17:32.389459+0000","last_peered":"2024-04-25T13:17:32.389459+0000","last_clean":"2024-04-25T13:17:32.389459+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:17:32.389459+0000","last_undegraded":"2024-04-25T13:17:32.389459+0000","last_fullsized":"2024-04-25T13:17:32.389459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.389377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.389377+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.389377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:22.479812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.303931+0000","last_change":"2024-04-25T13:17:28.303957+0000","last_active":"2024-04-25T13:17:28.303931+0000","last_peered":"2024-04-25T13:17:28.303931+0000","last_clean":"2024-04-25T13:17:28.303931+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:17:28.303931+0000","last_undegraded":"2024-04-25T13:17:28.303931+0000","last_fullsized":"2024-04-25T13:17:28.303931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.303847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.303847+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.303847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:24.404404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.645957+0000","last_change":"2024-04-25T13:17:34.645981+0000","last_active":"2024-04-25T13:17:34.645957+0000","last_peered":"2024-04-25T13:17:34.645957+0000","last_clean":"2024-04-25T13:17:34.645957+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:17:34.645957+0000","last_undegraded":"2024-04-25T13:17:34.645957+0000","last_fullsized":"2024-04-25T13:17:34.645957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.645868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.645868+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.645868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:35.968793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.367307+0000","last_change":"2024-04-25T13:17:34.367334+0000","last_active":"2024-04-25T13:17:34.367307+0000","last_peered":"2024-04-25T13:17:34.367307+0000","last_clean":"2024-04-25T13:17:34.367307+0000","last_became_active":"2024-04-25T13:16:50.369437+0000","last_became_peered":"2024-04-25T13:16:50.369437+0000","last_unstale":"2024-04-25T13:17:34.367307+0000","last_undegraded":"2024-04-25T13:17:34.367307+0000","last_fullsized":"2024-04-25T13:17:34.367307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.367232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.367232+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.367232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:47.773508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.084378+0000","last_change":"2024-04-25T13:17:36.084405+0000","last_active":"2024-04-25T13:17:36.084378+0000","last_peered":"2024-04-25T13:17:36.084378+0000","last_clean":"2024-04-25T13:17:36.084378+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:17:36.084378+0000","last_undegraded":"2024-04-25T13:17:36.084378+0000","last_fullsized":"2024-04-25T13:17:36.084378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.084272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.084272+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.084272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:01.014556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.615894+0000","last_change":"2024-04-25T13:17:36.615920+0000","last_active":"2024-04-25T13:17:36.615894+0000","last_peered":"2024-04-25T13:17:36.615894+0000","last_clean":"2024-04-25T13:17:36.615894+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:17:36.615894+0000","last_undegraded":"2024-04-25T13:17:36.615894+0000","last_fullsized":"2024-04-25T13:17:36.615894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.615809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.615809+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.615809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:45.830710+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.280778+0000","last_change":"2024-04-25T13:17:30.280801+0000","last_active":"2024-04-25T13:17:30.280778+0000","last_peered":"2024-04-25T13:17:30.280778+0000","last_clean":"2024-04-25T13:17:30.280778+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:17:30.280778+0000","last_undegraded":"2024-04-25T13:17:30.280778+0000","last_fullsized":"2024-04-25T13:17:30.280778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.280693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.280693+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.280693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:49.230129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.211441+0000","last_change":"2024-04-25T13:17:41.211466+0000","last_active":"2024-04-25T13:17:41.211441+0000","last_peered":"2024-04-25T13:17:41.211441+0000","last_clean":"2024-04-25T13:17:41.211441+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:17:41.211441+0000","last_undegraded":"2024-04-25T13:17:41.211441+0000","last_fullsized":"2024-04-25T13:17:41.211441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.211360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.211360+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.211360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:30.751041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.229410+0000","last_change":"2024-04-25T13:17:28.229445+0000","last_active":"2024-04-25T13:17:28.229410+0000","last_peered":"2024-04-25T13:17:28.229410+0000","last_clean":"2024-04-25T13:17:28.229410+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:17:28.229410+0000","last_undegraded":"2024-04-25T13:17:28.229410+0000","last_fullsized":"2024-04-25T13:17:28.229410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.229301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.229301+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.229301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:30.289458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.319615+0000","last_change":"2024-04-25T13:17:37.319655+0000","last_active":"2024-04-25T13:17:37.319615+0000","last_peered":"2024-04-25T13:17:37.319615+0000","last_clean":"2024-04-25T13:17:37.319615+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:17:37.319615+0000","last_undegraded":"2024-04-25T13:17:37.319615+0000","last_fullsized":"2024-04-25T13:17:37.319615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.319529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.319529+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.319529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:39.688909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.639557+0000","last_change":"2024-04-25T13:17:26.639577+0000","last_active":"2024-04-25T13:17:26.639557+0000","last_peered":"2024-04-25T13:17:26.639557+0000","last_clean":"2024-04-25T13:17:26.639557+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:17:26.639557+0000","last_undegraded":"2024-04-25T13:17:26.639557+0000","last_fullsized":"2024-04-25T13:17:26.639557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.639492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.639492+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.639492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:02.561260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.603482+0000","last_change":"2024-04-25T13:17:38.603513+0000","last_active":"2024-04-25T13:17:38.603482+0000","last_peered":"2024-04-25T13:17:38.603482+0000","last_clean":"2024-04-25T13:17:38.603482+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:17:38.603482+0000","last_undegraded":"2024-04-25T13:17:38.603482+0000","last_fullsized":"2024-04-25T13:17:38.603482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.603384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.603384+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.603384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:21.373773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.091144+0000","last_change":"2024-04-25T13:17:38.091170+0000","last_active":"2024-04-25T13:17:38.091144+0000","last_peered":"2024-04-25T13:17:38.091144+0000","last_clean":"2024-04-25T13:17:38.091144+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:17:38.091144+0000","last_undegraded":"2024-04-25T13:17:38.091144+0000","last_fullsized":"2024-04-25T13:17:38.091144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.091048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.091048+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.091048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:33.571905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.404125+0000","last_change":"2024-04-25T13:17:31.404151+0000","last_active":"2024-04-25T13:17:31.404125+0000","last_peered":"2024-04-25T13:17:31.404125+0000","last_clean":"2024-04-25T13:17:31.404125+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:17:31.404125+0000","last_undegraded":"2024-04-25T13:17:31.404125+0000","last_fullsized":"2024-04-25T13:17:31.404125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.404043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.404043+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.404043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:26.159210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.277596+0000","last_change":"2024-04-25T13:17:38.277619+0000","last_active":"2024-04-25T13:17:38.277596+0000","last_peered":"2024-04-25T13:17:38.277596+0000","last_clean":"2024-04-25T13:17:38.277596+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:17:38.277596+0000","last_undegraded":"2024-04-25T13:17:38.277596+0000","last_fullsized":"2024-04-25T13:17:38.277596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.277515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.277515+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.277515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:04.349932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.312143+0000","last_change":"2024-04-25T13:17:30.312169+0000","last_active":"2024-04-25T13:17:30.312143+0000","last_peered":"2024-04-25T13:17:30.312143+0000","last_clean":"2024-04-25T13:17:30.312143+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:17:30.312143+0000","last_undegraded":"2024-04-25T13:17:30.312143+0000","last_fullsized":"2024-04-25T13:17:30.312143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.312058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.312058+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.312058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:29.952531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.100211+0000","last_change":"2024-04-25T13:17:38.100237+0000","last_active":"2024-04-25T13:17:38.100211+0000","last_peered":"2024-04-25T13:17:38.100211+0000","last_clean":"2024-04-25T13:17:38.100211+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:17:38.100211+0000","last_undegraded":"2024-04-25T13:17:38.100211+0000","last_fullsized":"2024-04-25T13:17:38.100211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.100124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.100124+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.100124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:02.103015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.664713+0000","last_change":"2024-04-25T13:17:32.664764+0000","last_active":"2024-04-25T13:17:32.664713+0000","last_peered":"2024-04-25T13:17:32.664713+0000","last_clean":"2024-04-25T13:17:32.664713+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:17:32.664713+0000","last_undegraded":"2024-04-25T13:17:32.664713+0000","last_fullsized":"2024-04-25T13:17:32.664713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.664594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.664594+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.664594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.964895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.272059+0000","last_change":"2024-04-25T13:17:36.272103+0000","last_active":"2024-04-25T13:17:36.272059+0000","last_peered":"2024-04-25T13:17:36.272059+0000","last_clean":"2024-04-25T13:17:36.272059+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:17:36.272059+0000","last_undegraded":"2024-04-25T13:17:36.272059+0000","last_fullsized":"2024-04-25T13:17:36.272059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.271954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.271954+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.271954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:48.130301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.655605+0000","last_change":"2024-04-25T13:17:32.655672+0000","last_active":"2024-04-25T13:17:32.655605+0000","last_peered":"2024-04-25T13:17:32.655605+0000","last_clean":"2024-04-25T13:17:32.655605+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:17:32.655605+0000","last_undegraded":"2024-04-25T13:17:32.655605+0000","last_fullsized":"2024-04-25T13:17:32.655605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.655481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.655481+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.655481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.116872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.619464+0000","last_change":"2024-04-25T13:17:39.619491+0000","last_active":"2024-04-25T13:17:39.619464+0000","last_peered":"2024-04-25T13:17:39.619464+0000","last_clean":"2024-04-25T13:17:39.619464+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:17:39.619464+0000","last_undegraded":"2024-04-25T13:17:39.619464+0000","last_fullsized":"2024-04-25T13:17:39.619464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.619369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.619369+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.619369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:03.702175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.660906+0000","last_change":"2024-04-25T13:17:40.660930+0000","last_active":"2024-04-25T13:17:40.660906+0000","last_peered":"2024-04-25T13:17:40.660906+0000","last_clean":"2024-04-25T13:17:40.660906+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:17:40.660906+0000","last_undegraded":"2024-04-25T13:17:40.660906+0000","last_fullsized":"2024-04-25T13:17:40.660906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.660822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.660822+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.660822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:33.194608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.133771+0000","last_change":"2024-04-25T13:17:45.133809+0000","last_active":"2024-04-25T13:17:45.133771+0000","last_peered":"2024-04-25T13:17:45.133771+0000","last_clean":"2024-04-25T13:17:45.133771+0000","last_became_active":"2024-04-25T13:16:50.365415+0000","last_became_peered":"2024-04-25T13:16:50.365415+0000","last_unstale":"2024-04-25T13:17:45.133771+0000","last_undegraded":"2024-04-25T13:17:45.133771+0000","last_fullsized":"2024-04-25T13:17:45.133771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.133663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.133663+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.133663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.233922+0000","last_change":"2024-04-25T13:17:29.233943+0000","last_active":"2024-04-25T13:17:29.233922+0000","last_peered":"2024-04-25T13:17:29.233922+0000","last_clean":"2024-04-25T13:17:29.233922+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:17:29.233922+0000","last_undegraded":"2024-04-25T13:17:29.233922+0000","last_fullsized":"2024-04-25T13:17:29.233922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.233845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.233845+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.233845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:35.999883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.334032+0000","last_change":"2024-04-25T13:17:35.334100+0000","last_active":"2024-04-25T13:17:35.334032+0000","last_peered":"2024-04-25T13:17:35.334032+0000","last_clean":"2024-04-25T13:17:35.334032+0000","last_became_active":"2024-04-25T13:16:50.370066+0000","last_became_peered":"2024-04-25T13:16:50.370066+0000","last_unstale":"2024-04-25T13:17:35.334032+0000","last_undegraded":"2024-04-25T13:17:35.334032+0000","last_fullsized":"2024-04-25T13:17:35.334032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.333942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.333942+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.333942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:24.507257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.338456+0000","last_change":"2024-04-25T13:17:36.338488+0000","last_active":"2024-04-25T13:17:36.338456+0000","last_peered":"2024-04-25T13:17:36.338456+0000","last_clean":"2024-04-25T13:17:36.338456+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:17:36.338456+0000","last_undegraded":"2024-04-25T13:17:36.338456+0000","last_fullsized":"2024-04-25T13:17:36.338456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.338371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.338371+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.338371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:28.599953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.179999+0000","last_change":"2024-04-25T13:17:30.180026+0000","last_active":"2024-04-25T13:17:30.179999+0000","last_peered":"2024-04-25T13:17:30.179999+0000","last_clean":"2024-04-25T13:17:30.179999+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:17:30.179999+0000","last_undegraded":"2024-04-25T13:17:30.179999+0000","last_fullsized":"2024-04-25T13:17:30.179999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.179905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.179905+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.179905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:39.946829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.242973+0000","last_change":"2024-04-25T13:17:40.242998+0000","last_active":"2024-04-25T13:17:40.242973+0000","last_peered":"2024-04-25T13:17:40.242973+0000","last_clean":"2024-04-25T13:17:40.242973+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:17:40.242973+0000","last_undegraded":"2024-04-25T13:17:40.242973+0000","last_fullsized":"2024-04-25T13:17:40.242973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.242883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.242883+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.242883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:32.205878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.691816+0000","last_change":"2024-04-25T13:17:29.691861+0000","last_active":"2024-04-25T13:17:29.691816+0000","last_peered":"2024-04-25T13:17:29.691816+0000","last_clean":"2024-04-25T13:17:29.691816+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:17:29.691816+0000","last_undegraded":"2024-04-25T13:17:29.691816+0000","last_fullsized":"2024-04-25T13:17:29.691816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.691732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.691732+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.691732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:10.916700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.057888+0000","last_change":"2024-04-25T13:17:35.057914+0000","last_active":"2024-04-25T13:17:35.057888+0000","last_peered":"2024-04-25T13:17:35.057888+0000","last_clean":"2024-04-25T13:17:35.057888+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:17:35.057888+0000","last_undegraded":"2024-04-25T13:17:35.057888+0000","last_fullsized":"2024-04-25T13:17:35.057888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.057799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.057799+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.057799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:29.451792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.117323+0000","last_change":"2024-04-25T13:17:39.117346+0000","last_active":"2024-04-25T13:17:39.117323+0000","last_peered":"2024-04-25T13:17:39.117323+0000","last_clean":"2024-04-25T13:17:39.117323+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:17:39.117323+0000","last_undegraded":"2024-04-25T13:17:39.117323+0000","last_fullsized":"2024-04-25T13:17:39.117323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.117237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.117237+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.117237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:43.899259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":120093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:49.870 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:49.871 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T13:16:09.203474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:49.871 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T13:16:13.225464+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:49.872 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T13:18:06.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:06.677 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:09.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:18:09.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.987+0000 7f975a3ad640 1 Processor -- start 2024-04-25T13:18:09.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.987+0000 7f975a3ad640 1 -- start start 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.987+0000 7f975a3ad640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9754152280 0x7f97541591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.987+0000 7f975a3ad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97540c3cb0 0x7f9754159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.987+0000 7f975a3ad640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975415b610 con 0x7f9754151ea0 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.987+0000 7f975a3ad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f975406f300 con 0x7f97540c3cb0 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f975a3ad640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f975406e6f0 con 0x7f9754152280 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f9753fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9754151ea0 0x7f97540c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37022/0 (socket says 172.21.15.26:37022) 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f9753fff640 1 -- 172.21.15.26:0/4042835377 learned_addr learned my addr 172.21.15.26:0/4042835377 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:18:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f975894a640 1 --2- 172.21.15.26:0/4042835377 >> v2:172.21.15.26:3300/0 conn(0x7f97540c3cb0 0x7f9754159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f97537fe640 1 --2- 172.21.15.26:0/4042835377 >> v2:172.21.15.169:3300/0 conn(0x7f9754152280 0x7f97541591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f9752ffd640 1 -- 172.21.15.26:0/4042835377 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835527809 0 0) 0x7f975415b610 con 0x7f9754151ea0 2024-04-25T13:18:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f9752ffd640 1 -- 172.21.15.26:0/4042835377 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f973c003520 con 0x7f9754151ea0 2024-04-25T13:18:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f975894a640 1 -- 172.21.15.26:0/4042835377 >> v2:172.21.15.169:3300/0 conn(0x7f9754152280 msgr2=0x7f97541591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f975894a640 1 --2- 172.21.15.26:0/4042835377 >> v2:172.21.15.169:3300/0 conn(0x7f9754152280 0x7f97541591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f975894a640 1 -- 172.21.15.26:0/4042835377 >> v1:172.21.15.26:6789/0 conn(0x7f9754151ea0 legacy=0x7f97540c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.988+0000 7f975894a640 1 -- 172.21.15.26:0/4042835377 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975406e9d0 con 0x7f97540c3cb0 2024-04-25T13:18:09.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.989+0000 7f975894a640 1 --2- 172.21.15.26:0/4042835377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97540c3cb0 0x7f9754159710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f975406c3e0 tx=0x7f974c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306f8b9214aac32f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:09.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.989+0000 7f9752ffd640 1 -- 172.21.15.26:0/4042835377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c007740 con 0x7f97540c3cb0 2024-04-25T13:18:09.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.989+0000 7f9752ffd640 1 -- 172.21.15.26:0/4042835377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c0078e0 con 0x7f97540c3cb0 2024-04-25T13:18:09.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.989+0000 7f9752ffd640 1 -- 172.21.15.26:0/4042835377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c007c90 con 0x7f97540c3cb0 2024-04-25T13:18:09.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.989+0000 7f975a3ad640 1 -- 172.21.15.26:0/4042835377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97540c3cb0 msgr2=0x7f9754159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:09.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.989+0000 7f975a3ad640 1 --2- 172.21.15.26:0/4042835377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97540c3cb0 0x7f9754159710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f975406c3e0 tx=0x7f974c02a710 comp rx=0 tx=0).stop 2024-04-25T13:18:09.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.990+0000 7f975a3ad640 1 -- 172.21.15.26:0/4042835377 shutdown_connections 2024-04-25T13:18:09.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.990+0000 7f975a3ad640 1 --2- 172.21.15.26:0/4042835377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97540c3cb0 0x7f9754159710 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:09.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.990+0000 7f975a3ad640 1 --2- 172.21.15.26:0/4042835377 >> v2:172.21.15.169:3300/0 conn(0x7f9754152280 0x7f97541591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:09.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.990+0000 7f975a3ad640 1 -- 172.21.15.26:0/4042835377 >> 172.21.15.26:0/4042835377 conn(0x7f97540c8f00 msgr2=0x7f97540c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:09.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.990+0000 7f975a3ad640 1 -- 172.21.15.26:0/4042835377 shutdown_connections 2024-04-25T13:18:09.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.990+0000 7f975a3ad640 1 -- 172.21.15.26:0/4042835377 wait complete. 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.991+0000 7f975a3ad640 1 Processor -- start 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.991+0000 7f975a3ad640 1 -- start start 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f975a3ad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97540c3cb0 0x7f9754155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f975a3ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9754151ea0 0x7f9754156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f975a3ad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97541570c0 0x7f9754155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f975a3ad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f97540c8cb0 con 0x7f9754151ea0 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f975a3ad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f975406ef90 con 0x7f97541570c0 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f975a3ad640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f975415b2d0 con 0x7f97540c3cb0 2024-04-25T13:18:09.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9754151ea0 0x7f9754156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9754151ea0 0x7f9754156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58666/0 (socket says 172.21.15.26:58666) 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 -- 172.21.15.26:0/3333538350 learned_addr learned my addr 172.21.15.26:0/3333538350 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f9753fff640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97540c3cb0 0x7f9754155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f975894a640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97541570c0 0x7f9754155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 -- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97540c3cb0 msgr2=0x7f9754155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97540c3cb0 0x7f9754155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 -- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97541570c0 msgr2=0x7f9754155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97541570c0 0x7f9754155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.992+0000 7f97537fe640 1 -- 172.21.15.26:0/3333538350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9754157540 con 0x7f9754151ea0 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.993+0000 7f97537fe640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9754151ea0 0x7f9754156b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f974800d5d0 tx=0x7f974800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.993+0000 7f9750ff9640 1 -- 172.21.15.26:0/3333538350 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748004240 con 0x7f9754151ea0 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.993+0000 7f9750ff9640 1 -- 172.21.15.26:0/3333538350 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480043e0 con 0x7f9754151ea0 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.993+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97541f1620 con 0x7f9754151ea0 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.993+0000 7f9750ff9640 1 -- 172.21.15.26:0/3333538350 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748003830 con 0x7f9754151ea0 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.993+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97541f18c0 con 0x7f9754151ea0 2024-04-25T13:18:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.994+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9754150850 con 0x7f9754151ea0 2024-04-25T13:18:09.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.994+0000 7f9750ff9640 1 -- 172.21.15.26:0/3333538350 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97480039d0 con 0x7f9754151ea0 2024-04-25T13:18:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.995+0000 7f9750ff9640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f974006c920 0x7f974006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.995+0000 7f9750ff9640 1 -- 172.21.15.26:0/3333538350 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f974808c0a0 con 0x7f9754151ea0 2024-04-25T13:18:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.995+0000 7f9753fff640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f974006c920 0x7f974006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:09.996+0000 7f9753fff640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f974006c920 0x7f974006ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9744005880 tx=0x7f9744009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.000+0000 7f9750ff9640 1 -- 172.21.15.26:0/3333538350 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9754150850 con 0x7f9754151ea0 2024-04-25T13:18:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.182+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 --> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9754072100 con 0x7f974006c920 2024-04-25T13:18:10.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.190+0000 7f9750ff9640 1 -- 172.21.15.26:0/3333538350 <== mgr.4105 v2:172.21.15.169:6832/1178802827 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332764 (secure 0 0 0) 0x7f9754072100 con 0x7f974006c920 2024-04-25T13:18:10.194 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:18:10.196 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-25T13:18:10.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f974006c920 msgr2=0x7f974006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f974006c920 0x7f974006ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9744005880 tx=0x7f9744009040 comp rx=0 tx=0).stop 2024-04-25T13:18:10.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9754151ea0 msgr2=0x7f9754156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9754151ea0 0x7f9754156b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f974800d5d0 tx=0x7f974800da90 comp rx=0 tx=0).stop 2024-04-25T13:18:10.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 shutdown_connections 2024-04-25T13:18:10.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f974006c920 0x7f974006ede0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97541570c0 0x7f9754155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9754151ea0 0x7f9754156b80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 --2- 172.21.15.26:0/3333538350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97540c3cb0 0x7f9754155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 >> 172.21.15.26:0/3333538350 conn(0x7f97540c8f00 msgr2=0x7f975414ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:10.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 shutdown_connections 2024-04-25T13:18:10.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.194+0000 7f975a3ad640 1 -- 172.21.15.26:0/3333538350 wait complete. 2024-04-25T13:18:10.205 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-04-25T13:18:09.192535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003787"},"pg_stats":[{"pgid":"2.1f","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.700223+0000","last_change":"2024-04-25T13:17:28.700254+0000","last_active":"2024-04-25T13:17:28.700223+0000","last_peered":"2024-04-25T13:17:28.700223+0000","last_clean":"2024-04-25T13:17:28.700223+0000","last_became_active":"2024-04-25T13:16:09.227717+0000","last_became_peered":"2024-04-25T13:16:09.227717+0000","last_unstale":"2024-04-25T13:17:28.700223+0000","last_undegraded":"2024-04-25T13:17:28.700223+0000","last_fullsized":"2024-04-25T13:17:28.700223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T13:17:28.700161+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T13:17:28.700161+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.700161+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:05.837904+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.267440+0000","last_change":"2024-04-25T13:17:37.267466+0000","last_active":"2024-04-25T13:17:37.267440+0000","last_peered":"2024-04-25T13:17:37.267440+0000","last_clean":"2024-04-25T13:17:37.267440+0000","last_became_active":"2024-04-25T13:16:10.235478+0000","last_became_peered":"2024-04-25T13:16:10.235478+0000","last_unstale":"2024-04-25T13:17:37.267440+0000","last_undegraded":"2024-04-25T13:17:37.267440+0000","last_fullsized":"2024-04-25T13:17:37.267440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.267359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.267359+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.267359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:23.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.340999+0000","last_change":"2024-04-25T13:17:39.341027+0000","last_active":"2024-04-25T13:17:39.340999+0000","last_peered":"2024-04-25T13:17:39.340999+0000","last_clean":"2024-04-25T13:17:39.340999+0000","last_became_active":"2024-04-25T13:16:14.255467+0000","last_became_peered":"2024-04-25T13:16:14.255467+0000","last_unstale":"2024-04-25T13:17:39.340999+0000","last_undegraded":"2024-04-25T13:17:39.340999+0000","last_fullsized":"2024-04-25T13:17:39.340999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.340909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.340909+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.340909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:18.806485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.271377+0000","last_change":"2024-04-25T13:17:31.271428+0000","last_active":"2024-04-25T13:17:31.271377+0000","last_peered":"2024-04-25T13:17:31.271377+0000","last_clean":"2024-04-25T13:17:31.271377+0000","last_became_active":"2024-04-25T13:16:09.226991+0000","last_became_peered":"2024-04-25T13:16:09.226991+0000","last_unstale":"2024-04-25T13:17:31.271377+0000","last_undegraded":"2024-04-25T13:17:31.271377+0000","last_fullsized":"2024-04-25T13:17:31.271377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-25T13:17:31.271258+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-25T13:17:31.271258+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.271258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:54.598547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.743663+0000","last_change":"2024-04-25T13:17:37.743689+0000","last_active":"2024-04-25T13:17:37.743663+0000","last_peered":"2024-04-25T13:17:37.743663+0000","last_clean":"2024-04-25T13:17:37.743663+0000","last_became_active":"2024-04-25T13:16:10.237415+0000","last_became_peered":"2024-04-25T13:16:10.237415+0000","last_unstale":"2024-04-25T13:17:37.743663+0000","last_undegraded":"2024-04-25T13:17:37.743663+0000","last_fullsized":"2024-04-25T13:17:37.743663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.743559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.743559+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.743559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:13.860985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.617294+0000","last_change":"2024-04-25T13:17:41.617322+0000","last_active":"2024-04-25T13:17:41.617294+0000","last_peered":"2024-04-25T13:17:41.617294+0000","last_clean":"2024-04-25T13:17:41.617294+0000","last_became_active":"2024-04-25T13:16:50.361435+0000","last_became_peered":"2024-04-25T13:16:50.361435+0000","last_unstale":"2024-04-25T13:17:41.617294+0000","last_undegraded":"2024-04-25T13:17:41.617294+0000","last_fullsized":"2024-04-25T13:17:41.617294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.617198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.617198+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.617198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:13.214379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.131385+0000","last_change":"2024-04-25T13:17:37.131426+0000","last_active":"2024-04-25T13:17:37.131385+0000","last_peered":"2024-04-25T13:17:37.131385+0000","last_clean":"2024-04-25T13:17:37.131385+0000","last_became_active":"2024-04-25T13:16:09.235274+0000","last_became_peered":"2024-04-25T13:16:09.235274+0000","last_unstale":"2024-04-25T13:17:37.131385+0000","last_undegraded":"2024-04-25T13:17:37.131385+0000","last_fullsized":"2024-04-25T13:17:37.131385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T13:17:37.131304+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T13:17:37.131304+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.131304+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:36.321695+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.157584+0000","last_change":"2024-04-25T13:17:43.157622+0000","last_active":"2024-04-25T13:17:43.157584+0000","last_peered":"2024-04-25T13:17:43.157584+0000","last_clean":"2024-04-25T13:17:43.157584+0000","last_became_active":"2024-04-25T13:16:10.241217+0000","last_became_peered":"2024-04-25T13:16:10.241217+0000","last_unstale":"2024-04-25T13:17:43.157584+0000","last_undegraded":"2024-04-25T13:17:43.157584+0000","last_fullsized":"2024-04-25T13:17:43.157584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.157480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.157480+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.157480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:04.681722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.589105+0000","last_change":"2024-04-25T13:17:37.589149+0000","last_active":"2024-04-25T13:17:37.589105+0000","last_peered":"2024-04-25T13:17:37.589105+0000","last_clean":"2024-04-25T13:17:37.589105+0000","last_became_active":"2024-04-25T13:16:14.256882+0000","last_became_peered":"2024-04-25T13:16:14.256882+0000","last_unstale":"2024-04-25T13:17:37.589105+0000","last_undegraded":"2024-04-25T13:17:37.589105+0000","last_fullsized":"2024-04-25T13:17:37.589105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.589002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.589002+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.589002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:00.306087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.146370+0000","last_change":"2024-04-25T13:17:32.146417+0000","last_active":"2024-04-25T13:17:32.146370+0000","last_peered":"2024-04-25T13:17:32.146370+0000","last_clean":"2024-04-25T13:17:32.146370+0000","last_became_active":"2024-04-25T13:16:09.231198+0000","last_became_peered":"2024-04-25T13:16:09.231198+0000","last_unstale":"2024-04-25T13:17:32.146370+0000","last_undegraded":"2024-04-25T13:17:32.146370+0000","last_fullsized":"2024-04-25T13:17:32.146370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:32.146285+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:32.146285+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.146285+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:37.180242+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.193508+0000","last_change":"2024-04-25T13:17:44.193531+0000","last_active":"2024-04-25T13:17:44.193508+0000","last_peered":"2024-04-25T13:17:44.193508+0000","last_clean":"2024-04-25T13:17:44.193508+0000","last_became_active":"2024-04-25T13:16:10.241664+0000","last_became_peered":"2024-04-25T13:16:10.241664+0000","last_unstale":"2024-04-25T13:17:44.193508+0000","last_undegraded":"2024-04-25T13:17:44.193508+0000","last_fullsized":"2024-04-25T13:17:44.193508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.193428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.193428+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.193428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:35.455927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.607821+0000","last_change":"2024-04-25T13:17:39.607857+0000","last_active":"2024-04-25T13:17:39.607821+0000","last_peered":"2024-04-25T13:17:39.607821+0000","last_clean":"2024-04-25T13:17:39.607821+0000","last_became_active":"2024-04-25T13:16:14.259430+0000","last_became_peered":"2024-04-25T13:16:14.259430+0000","last_unstale":"2024-04-25T13:17:39.607821+0000","last_undegraded":"2024-04-25T13:17:39.607821+0000","last_fullsized":"2024-04-25T13:17:39.607821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.607720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.607720+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.607720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:19.112454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.588371+0000","last_change":"2024-04-25T13:17:37.588427+0000","last_active":"2024-04-25T13:17:37.588371+0000","last_peered":"2024-04-25T13:17:37.588371+0000","last_clean":"2024-04-25T13:17:37.588371+0000","last_became_active":"2024-04-25T13:16:10.235944+0000","last_became_peered":"2024-04-25T13:16:10.235944+0000","last_unstale":"2024-04-25T13:17:37.588371+0000","last_undegraded":"2024-04-25T13:17:37.588371+0000","last_fullsized":"2024-04-25T13:17:37.588371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.588232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.588232+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.588232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:21.299827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.126400+0000","last_change":"2024-04-25T13:17:35.126432+0000","last_active":"2024-04-25T13:17:35.126400+0000","last_peered":"2024-04-25T13:17:35.126400+0000","last_clean":"2024-04-25T13:17:35.126400+0000","last_became_active":"2024-04-25T13:16:09.232830+0000","last_became_peered":"2024-04-25T13:16:09.232830+0000","last_unstale":"2024-04-25T13:17:35.126400+0000","last_undegraded":"2024-04-25T13:17:35.126400+0000","last_fullsized":"2024-04-25T13:17:35.126400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:35.126320+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:35.126320+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.126320+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:31.765459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.611072+0000","last_change":"2024-04-25T13:17:36.611097+0000","last_active":"2024-04-25T13:17:36.611072+0000","last_peered":"2024-04-25T13:17:36.611072+0000","last_clean":"2024-04-25T13:17:36.611072+0000","last_became_active":"2024-04-25T13:16:14.255797+0000","last_became_peered":"2024-04-25T13:16:14.255797+0000","last_unstale":"2024-04-25T13:17:36.611072+0000","last_undegraded":"2024-04-25T13:17:36.611072+0000","last_fullsized":"2024-04-25T13:17:36.611072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.610966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.610966+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.610966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:12.072905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.273959+0000","last_change":"2024-04-25T13:17:34.274015+0000","last_active":"2024-04-25T13:17:34.273959+0000","last_peered":"2024-04-25T13:17:34.273959+0000","last_clean":"2024-04-25T13:17:34.273959+0000","last_became_active":"2024-04-25T13:16:10.227690+0000","last_became_peered":"2024-04-25T13:16:10.227690+0000","last_unstale":"2024-04-25T13:17:34.273959+0000","last_undegraded":"2024-04-25T13:17:34.273959+0000","last_fullsized":"2024-04-25T13:17:34.273959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.273852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.273852+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.273852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:07.559111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.077532+0000","last_change":"2024-04-25T13:17:29.077578+0000","last_active":"2024-04-25T13:17:29.077532+0000","last_peered":"2024-04-25T13:17:29.077532+0000","last_clean":"2024-04-25T13:17:29.077532+0000","last_became_active":"2024-04-25T13:16:09.224018+0000","last_became_peered":"2024-04-25T13:16:09.224018+0000","last_unstale":"2024-04-25T13:17:29.077532+0000","last_undegraded":"2024-04-25T13:17:29.077532+0000","last_fullsized":"2024-04-25T13:17:29.077532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:29.077432+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:29.077432+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.077432+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:04.638589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.584363+0000","last_change":"2024-04-25T13:17:42.584396+0000","last_active":"2024-04-25T13:17:42.584363+0000","last_peered":"2024-04-25T13:17:42.584363+0000","last_clean":"2024-04-25T13:17:42.584363+0000","last_became_active":"2024-04-25T13:16:50.369812+0000","last_became_peered":"2024-04-25T13:16:50.369812+0000","last_unstale":"2024-04-25T13:17:42.584363+0000","last_undegraded":"2024-04-25T13:17:42.584363+0000","last_fullsized":"2024-04-25T13:17:42.584363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.584270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.584270+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.584270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:00.550128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.255907+0000","last_change":"2024-04-25T13:17:35.255954+0000","last_active":"2024-04-25T13:17:35.255907+0000","last_peered":"2024-04-25T13:17:35.255907+0000","last_clean":"2024-04-25T13:17:35.255907+0000","last_became_active":"2024-04-25T13:16:10.229808+0000","last_became_peered":"2024-04-25T13:16:10.229808+0000","last_unstale":"2024-04-25T13:17:35.255907+0000","last_undegraded":"2024-04-25T13:17:35.255907+0000","last_fullsized":"2024-04-25T13:17:35.255907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.255816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.255816+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.255816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:18.891438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.122653+0000","last_change":"2024-04-25T13:17:30.122688+0000","last_active":"2024-04-25T13:17:30.122653+0000","last_peered":"2024-04-25T13:17:30.122653+0000","last_clean":"2024-04-25T13:17:30.122653+0000","last_became_active":"2024-04-25T13:16:09.225126+0000","last_became_peered":"2024-04-25T13:16:09.225126+0000","last_unstale":"2024-04-25T13:17:30.122653+0000","last_undegraded":"2024-04-25T13:17:30.122653+0000","last_fullsized":"2024-04-25T13:17:30.122653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T13:17:30.122564+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T13:17:30.122564+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.122564+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:55.870044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.195308+0000","last_change":"2024-04-25T13:17:43.195338+0000","last_active":"2024-04-25T13:17:43.195308+0000","last_peered":"2024-04-25T13:17:43.195308+0000","last_clean":"2024-04-25T13:17:43.195308+0000","last_became_active":"2024-04-25T13:16:14.268301+0000","last_became_peered":"2024-04-25T13:16:14.268301+0000","last_unstale":"2024-04-25T13:17:43.195308+0000","last_undegraded":"2024-04-25T13:17:43.195308+0000","last_fullsized":"2024-04-25T13:17:43.195308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.195225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.195225+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.195225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:09.185333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.569073+0000","last_change":"2024-04-25T13:17:29.569098+0000","last_active":"2024-04-25T13:17:29.569073+0000","last_peered":"2024-04-25T13:17:29.569073+0000","last_clean":"2024-04-25T13:17:29.569073+0000","last_became_active":"2024-04-25T13:16:10.220232+0000","last_became_peered":"2024-04-25T13:16:10.220232+0000","last_unstale":"2024-04-25T13:17:29.569073+0000","last_undegraded":"2024-04-25T13:17:29.569073+0000","last_fullsized":"2024-04-25T13:17:29.569073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.568975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.568975+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.568975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:56.898866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.128035+0000","last_change":"2024-04-25T13:17:33.128066+0000","last_active":"2024-04-25T13:17:33.128035+0000","last_peered":"2024-04-25T13:17:33.128035+0000","last_clean":"2024-04-25T13:17:33.128035+0000","last_became_active":"2024-04-25T13:16:09.231344+0000","last_became_peered":"2024-04-25T13:16:09.231344+0000","last_unstale":"2024-04-25T13:17:33.128035+0000","last_undegraded":"2024-04-25T13:17:33.128035+0000","last_fullsized":"2024-04-25T13:17:33.128035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-25T13:17:33.127947+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-25T13:17:33.127947+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.127947+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:24.609183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.651947+0000","last_change":"2024-04-25T13:17:40.651977+0000","last_active":"2024-04-25T13:17:40.651947+0000","last_peered":"2024-04-25T13:17:40.651947+0000","last_clean":"2024-04-25T13:17:40.651947+0000","last_became_active":"2024-04-25T13:16:14.259237+0000","last_became_peered":"2024-04-25T13:16:14.259237+0000","last_unstale":"2024-04-25T13:17:40.651947+0000","last_undegraded":"2024-04-25T13:17:40.651947+0000","last_fullsized":"2024-04-25T13:17:40.651947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.651823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.651823+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.651823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:36.327868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.616326+0000","last_change":"2024-04-25T13:17:33.616352+0000","last_active":"2024-04-25T13:17:33.616326+0000","last_peered":"2024-04-25T13:17:33.616326+0000","last_clean":"2024-04-25T13:17:33.616326+0000","last_became_active":"2024-04-25T13:16:10.228402+0000","last_became_peered":"2024-04-25T13:16:10.228402+0000","last_unstale":"2024-04-25T13:17:33.616326+0000","last_undegraded":"2024-04-25T13:17:33.616326+0000","last_fullsized":"2024-04-25T13:17:33.616326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.616232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.616232+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.616232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:45.264232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.545246+0000","last_change":"2024-04-25T13:17:33.545285+0000","last_active":"2024-04-25T13:17:33.545246+0000","last_peered":"2024-04-25T13:17:33.545246+0000","last_clean":"2024-04-25T13:17:33.545246+0000","last_became_active":"2024-04-25T13:16:09.235780+0000","last_became_peered":"2024-04-25T13:16:09.235780+0000","last_unstale":"2024-04-25T13:17:33.545246+0000","last_undegraded":"2024-04-25T13:17:33.545246+0000","last_fullsized":"2024-04-25T13:17:33.545246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-25T13:17:33.545144+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-25T13:17:33.545144+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.545144+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:08.278257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.653693+0000","last_change":"2024-04-25T13:17:35.653722+0000","last_active":"2024-04-25T13:17:35.653693+0000","last_peered":"2024-04-25T13:17:35.653693+0000","last_clean":"2024-04-25T13:17:35.653693+0000","last_became_active":"2024-04-25T13:16:14.255367+0000","last_became_peered":"2024-04-25T13:16:14.255367+0000","last_unstale":"2024-04-25T13:17:35.653693+0000","last_undegraded":"2024-04-25T13:17:35.653693+0000","last_fullsized":"2024-04-25T13:17:35.653693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.653590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.653590+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.653590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:07.477423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.297522+0000","last_change":"2024-04-25T13:17:38.297547+0000","last_active":"2024-04-25T13:17:38.297522+0000","last_peered":"2024-04-25T13:17:38.297522+0000","last_clean":"2024-04-25T13:17:38.297522+0000","last_became_active":"2024-04-25T13:16:10.235974+0000","last_became_peered":"2024-04-25T13:16:10.235974+0000","last_unstale":"2024-04-25T13:17:38.297522+0000","last_undegraded":"2024-04-25T13:17:38.297522+0000","last_fullsized":"2024-04-25T13:17:38.297522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.297433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.297433+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.297433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:20.416292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.054252+0000","last_change":"2024-04-25T13:17:33.054289+0000","last_active":"2024-04-25T13:17:33.054252+0000","last_peered":"2024-04-25T13:17:33.054252+0000","last_clean":"2024-04-25T13:17:33.054252+0000","last_became_active":"2024-04-25T13:16:09.233601+0000","last_became_peered":"2024-04-25T13:16:09.233601+0000","last_unstale":"2024-04-25T13:17:33.054252+0000","last_undegraded":"2024-04-25T13:17:33.054252+0000","last_fullsized":"2024-04-25T13:17:33.054252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-25T13:17:33.054144+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-25T13:17:33.054144+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.054144+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:08.477157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.352129+0000","last_change":"2024-04-25T13:17:43.352182+0000","last_active":"2024-04-25T13:17:43.352129+0000","last_peered":"2024-04-25T13:17:43.352129+0000","last_clean":"2024-04-25T13:17:43.352129+0000","last_became_active":"2024-04-25T13:16:14.260990+0000","last_became_peered":"2024-04-25T13:16:14.260990+0000","last_unstale":"2024-04-25T13:17:43.352129+0000","last_undegraded":"2024-04-25T13:17:43.352129+0000","last_fullsized":"2024-04-25T13:17:43.352129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.352024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.352024+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.352024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:14.229960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.087977+0000","last_change":"2024-04-25T13:17:27.087999+0000","last_active":"2024-04-25T13:17:27.087977+0000","last_peered":"2024-04-25T13:17:27.087977+0000","last_clean":"2024-04-25T13:17:27.087977+0000","last_became_active":"2024-04-25T13:16:10.225327+0000","last_became_peered":"2024-04-25T13:16:10.225327+0000","last_unstale":"2024-04-25T13:17:27.087977+0000","last_undegraded":"2024-04-25T13:17:27.087977+0000","last_fullsized":"2024-04-25T13:17:27.087977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.087901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.087901+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.087901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:48.021675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.098392+0000","last_change":"2024-04-25T13:17:36.098428+0000","last_active":"2024-04-25T13:17:36.098392+0000","last_peered":"2024-04-25T13:17:36.098392+0000","last_clean":"2024-04-25T13:17:36.098392+0000","last_became_active":"2024-04-25T13:16:09.234223+0000","last_became_peered":"2024-04-25T13:16:09.234223+0000","last_unstale":"2024-04-25T13:17:36.098392+0000","last_undegraded":"2024-04-25T13:17:36.098392+0000","last_fullsized":"2024-04-25T13:17:36.098392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:36.098296+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:36.098296+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.098296+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:12.838478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.768332+0000","last_change":"2024-04-25T13:17:41.768357+0000","last_active":"2024-04-25T13:17:41.768332+0000","last_peered":"2024-04-25T13:17:41.768332+0000","last_clean":"2024-04-25T13:17:41.768332+0000","last_became_active":"2024-04-25T13:16:14.259377+0000","last_became_peered":"2024-04-25T13:16:14.259377+0000","last_unstale":"2024-04-25T13:17:41.768332+0000","last_undegraded":"2024-04-25T13:17:41.768332+0000","last_fullsized":"2024-04-25T13:17:41.768332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.768245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.768245+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.768245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:02.897428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.239020+0000","last_change":"2024-04-25T13:17:39.239052+0000","last_active":"2024-04-25T13:17:39.239020+0000","last_peered":"2024-04-25T13:17:39.239020+0000","last_clean":"2024-04-25T13:17:39.239020+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:17:39.239020+0000","last_undegraded":"2024-04-25T13:17:39.239020+0000","last_fullsized":"2024-04-25T13:17:39.239020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.238893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.238893+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.238893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:25.981387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.086138+0000","last_change":"2024-04-25T13:17:31.086176+0000","last_active":"2024-04-25T13:17:31.086138+0000","last_peered":"2024-04-25T13:17:31.086138+0000","last_clean":"2024-04-25T13:17:31.086138+0000","last_became_active":"2024-04-25T13:16:09.228811+0000","last_became_peered":"2024-04-25T13:16:09.228811+0000","last_unstale":"2024-04-25T13:17:31.086138+0000","last_undegraded":"2024-04-25T13:17:31.086138+0000","last_fullsized":"2024-04-25T13:17:31.086138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-25T13:17:31.086046+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-25T13:17:31.086046+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.086046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.325190+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.127749+0000","last_change":"2024-04-25T13:17:39.127802+0000","last_active":"2024-04-25T13:17:39.127749+0000","last_peered":"2024-04-25T13:17:39.127749+0000","last_clean":"2024-04-25T13:17:39.127749+0000","last_became_active":"2024-04-25T13:16:14.255596+0000","last_became_peered":"2024-04-25T13:16:14.255596+0000","last_unstale":"2024-04-25T13:17:39.127749+0000","last_undegraded":"2024-04-25T13:17:39.127749+0000","last_fullsized":"2024-04-25T13:17:39.127749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.127648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.127648+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.127648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:55.352540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.618082+0000","last_change":"2024-04-25T13:17:33.618120+0000","last_active":"2024-04-25T13:17:33.618082+0000","last_peered":"2024-04-25T13:17:33.618082+0000","last_clean":"2024-04-25T13:17:33.618082+0000","last_became_active":"2024-04-25T13:16:10.231934+0000","last_became_peered":"2024-04-25T13:16:10.231934+0000","last_unstale":"2024-04-25T13:17:33.618082+0000","last_undegraded":"2024-04-25T13:17:33.618082+0000","last_fullsized":"2024-04-25T13:17:33.618082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.617974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.617974+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.617974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:09.916315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.358605+0000","last_change":"2024-04-25T13:17:33.358663+0000","last_active":"2024-04-25T13:17:33.358605+0000","last_peered":"2024-04-25T13:17:33.358605+0000","last_clean":"2024-04-25T13:17:33.358605+0000","last_became_active":"2024-04-25T13:16:09.230997+0000","last_became_peered":"2024-04-25T13:16:09.230997+0000","last_unstale":"2024-04-25T13:17:33.358605+0000","last_undegraded":"2024-04-25T13:17:33.358605+0000","last_fullsized":"2024-04-25T13:17:33.358605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:33.358487+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:33.358487+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.358487+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:59.123917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.156031+0000","last_change":"2024-04-25T13:17:41.156057+0000","last_active":"2024-04-25T13:17:41.156031+0000","last_peered":"2024-04-25T13:17:41.156031+0000","last_clean":"2024-04-25T13:17:41.156031+0000","last_became_active":"2024-04-25T13:16:14.266895+0000","last_became_peered":"2024-04-25T13:16:14.266895+0000","last_unstale":"2024-04-25T13:17:41.156031+0000","last_undegraded":"2024-04-25T13:17:41.156031+0000","last_fullsized":"2024-04-25T13:17:41.156031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.155934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.155934+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.155934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:27.406539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.016130+0000","last_change":"2024-04-25T13:17:34.016152+0000","last_active":"2024-04-25T13:17:34.016130+0000","last_peered":"2024-04-25T13:17:34.016130+0000","last_clean":"2024-04-25T13:17:34.016130+0000","last_became_active":"2024-04-25T13:16:10.224251+0000","last_became_peered":"2024-04-25T13:16:10.224251+0000","last_unstale":"2024-04-25T13:17:34.016130+0000","last_undegraded":"2024-04-25T13:17:34.016130+0000","last_fullsized":"2024-04-25T13:17:34.016130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.016033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.016033+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.016033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:34.556021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.439885+0000","last_change":"2024-04-25T13:17:27.439912+0000","last_active":"2024-04-25T13:17:27.439885+0000","last_peered":"2024-04-25T13:17:27.439885+0000","last_clean":"2024-04-25T13:17:27.439885+0000","last_became_active":"2024-04-25T13:16:09.221714+0000","last_became_peered":"2024-04-25T13:16:09.221714+0000","last_unstale":"2024-04-25T13:17:27.439885+0000","last_undegraded":"2024-04-25T13:17:27.439885+0000","last_fullsized":"2024-04-25T13:17:27.439885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:27.439809+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:27.439809+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.439809+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:05.079552+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.204494+0000","last_change":"2024-04-25T13:17:42.204555+0000","last_active":"2024-04-25T13:17:42.204494+0000","last_peered":"2024-04-25T13:17:42.204494+0000","last_clean":"2024-04-25T13:17:42.204494+0000","last_became_active":"2024-04-25T13:16:14.267834+0000","last_became_peered":"2024-04-25T13:16:14.267834+0000","last_unstale":"2024-04-25T13:17:42.204494+0000","last_undegraded":"2024-04-25T13:17:42.204494+0000","last_fullsized":"2024-04-25T13:17:42.204494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.204389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.204389+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.204389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:57.921440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.645710+0000","last_change":"2024-04-25T13:17:31.645735+0000","last_active":"2024-04-25T13:17:31.645710+0000","last_peered":"2024-04-25T13:17:31.645710+0000","last_clean":"2024-04-25T13:17:31.645710+0000","last_became_active":"2024-04-25T13:16:10.225523+0000","last_became_peered":"2024-04-25T13:16:10.225523+0000","last_unstale":"2024-04-25T13:17:31.645710+0000","last_undegraded":"2024-04-25T13:17:31.645710+0000","last_fullsized":"2024-04-25T13:17:31.645710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.645597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.645597+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.645597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:01.153298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.161767+0000","last_change":"2024-04-25T13:17:34.161802+0000","last_active":"2024-04-25T13:17:34.161767+0000","last_peered":"2024-04-25T13:17:34.161767+0000","last_clean":"2024-04-25T13:17:34.161767+0000","last_became_active":"2024-04-25T13:16:09.231923+0000","last_became_peered":"2024-04-25T13:16:09.231923+0000","last_unstale":"2024-04-25T13:17:34.161767+0000","last_undegraded":"2024-04-25T13:17:34.161767+0000","last_fullsized":"2024-04-25T13:17:34.161767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T13:17:34.161684+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T13:17:34.161684+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.161684+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:05.102733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.759193+0000","last_change":"2024-04-25T13:17:39.759219+0000","last_active":"2024-04-25T13:17:39.759193+0000","last_peered":"2024-04-25T13:17:39.759193+0000","last_clean":"2024-04-25T13:17:39.759193+0000","last_became_active":"2024-04-25T13:16:14.258104+0000","last_became_peered":"2024-04-25T13:16:14.258104+0000","last_unstale":"2024-04-25T13:17:39.759193+0000","last_undegraded":"2024-04-25T13:17:39.759193+0000","last_fullsized":"2024-04-25T13:17:39.759193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.759102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.759102+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.759102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:00:02.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.320603+0000","last_change":"2024-04-25T13:17:46.320641+0000","last_active":"2024-04-25T13:17:46.320603+0000","last_peered":"2024-04-25T13:17:46.320603+0000","last_clean":"2024-04-25T13:17:46.320603+0000","last_became_active":"2024-04-25T13:16:50.373669+0000","last_became_peered":"2024-04-25T13:16:50.373669+0000","last_unstale":"2024-04-25T13:17:46.320603+0000","last_undegraded":"2024-04-25T13:17:46.320603+0000","last_fullsized":"2024-04-25T13:17:46.320603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.320523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.320523+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.320523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:56.014825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.360716+0000","last_change":"2024-04-25T13:17:32.360756+0000","last_active":"2024-04-25T13:17:32.360716+0000","last_peered":"2024-04-25T13:17:32.360716+0000","last_clean":"2024-04-25T13:17:32.360716+0000","last_became_active":"2024-04-25T13:16:09.228434+0000","last_became_peered":"2024-04-25T13:16:09.228434+0000","last_unstale":"2024-04-25T13:17:32.360716+0000","last_undegraded":"2024-04-25T13:17:32.360716+0000","last_fullsized":"2024-04-25T13:17:32.360716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T13:17:32.360638+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T13:17:32.360638+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.360638+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:56.219989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.177891+0000","last_change":"2024-04-25T13:17:31.177891+0000","last_active":"2024-04-25T13:17:31.177891+0000","last_peered":"2024-04-25T13:17:31.177891+0000","last_clean":"2024-04-25T13:17:31.177891+0000","last_became_active":"2024-04-25T13:15:57.411625+0000","last_became_peered":"2024-04-25T13:15:57.411625+0000","last_unstale":"2024-04-25T13:17:31.177891+0000","last_undegraded":"2024-04-25T13:17:31.177891+0000","last_fullsized":"2024-04-25T13:17:31.177891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-25T13:17:31.177776+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-25T13:17:31.177776+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.177776+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.891107+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.727319+0000","last_change":"2024-04-25T13:17:42.727349+0000","last_active":"2024-04-25T13:17:42.727319+0000","last_peered":"2024-04-25T13:17:42.727319+0000","last_clean":"2024-04-25T13:17:42.727319+0000","last_became_active":"2024-04-25T13:16:14.257549+0000","last_became_peered":"2024-04-25T13:16:14.257549+0000","last_unstale":"2024-04-25T13:17:42.727319+0000","last_undegraded":"2024-04-25T13:17:42.727319+0000","last_fullsized":"2024-04-25T13:17:42.727319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.727210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.727210+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.727210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:11.092783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.173781+0000","last_change":"2024-04-25T13:17:46.173820+0000","last_active":"2024-04-25T13:17:46.173781+0000","last_peered":"2024-04-25T13:17:46.173781+0000","last_clean":"2024-04-25T13:17:46.173781+0000","last_became_active":"2024-04-25T13:16:50.365465+0000","last_became_peered":"2024-04-25T13:16:50.365465+0000","last_unstale":"2024-04-25T13:17:46.173781+0000","last_undegraded":"2024-04-25T13:17:46.173781+0000","last_fullsized":"2024-04-25T13:17:46.173781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.173689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.173689+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.173689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:57.064413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.390489+0000","last_change":"2024-04-25T13:17:30.390519+0000","last_active":"2024-04-25T13:17:30.390489+0000","last_peered":"2024-04-25T13:17:30.390489+0000","last_clean":"2024-04-25T13:17:30.390489+0000","last_became_active":"2024-04-25T13:16:09.225334+0000","last_became_peered":"2024-04-25T13:16:09.225334+0000","last_unstale":"2024-04-25T13:17:30.390489+0000","last_undegraded":"2024-04-25T13:17:30.390489+0000","last_fullsized":"2024-04-25T13:17:30.390489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T13:17:30.390410+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T13:17:30.390410+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.390410+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:33.829243+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.691747+0000","last_change":"2024-04-25T13:17:43.691774+0000","last_active":"2024-04-25T13:17:43.691747+0000","last_peered":"2024-04-25T13:17:43.691747+0000","last_clean":"2024-04-25T13:17:43.691747+0000","last_became_active":"2024-04-25T13:16:50.368538+0000","last_became_peered":"2024-04-25T13:16:50.368538+0000","last_unstale":"2024-04-25T13:17:43.691747+0000","last_undegraded":"2024-04-25T13:17:43.691747+0000","last_fullsized":"2024-04-25T13:17:43.691747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.691657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.691657+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.691657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:44.953828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.338865+0000","last_change":"2024-04-25T13:17:29.338891+0000","last_active":"2024-04-25T13:17:29.338865+0000","last_peered":"2024-04-25T13:17:29.338865+0000","last_clean":"2024-04-25T13:17:29.338865+0000","last_became_active":"2024-04-25T13:16:10.236210+0000","last_became_peered":"2024-04-25T13:16:10.236210+0000","last_unstale":"2024-04-25T13:17:29.338865+0000","last_undegraded":"2024-04-25T13:17:29.338865+0000","last_fullsized":"2024-04-25T13:17:29.338865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.338784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.338784+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.338784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:30.067038+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.085601+0000","last_change":"2024-04-25T13:17:28.085632+0000","last_active":"2024-04-25T13:17:28.085601+0000","last_peered":"2024-04-25T13:17:28.085601+0000","last_clean":"2024-04-25T13:17:28.085601+0000","last_became_active":"2024-04-25T13:16:09.222194+0000","last_became_peered":"2024-04-25T13:16:09.222194+0000","last_unstale":"2024-04-25T13:17:28.085601+0000","last_undegraded":"2024-04-25T13:17:28.085601+0000","last_fullsized":"2024-04-25T13:17:28.085601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:28.085527+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:28.085527+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.085527+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:36.689003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.793142+0000","last_change":"2024-04-25T13:17:42.793187+0000","last_active":"2024-04-25T13:17:42.793142+0000","last_peered":"2024-04-25T13:17:42.793142+0000","last_clean":"2024-04-25T13:17:42.793142+0000","last_became_active":"2024-04-25T13:16:14.260250+0000","last_became_peered":"2024-04-25T13:16:14.260250+0000","last_unstale":"2024-04-25T13:17:42.793142+0000","last_undegraded":"2024-04-25T13:17:42.793142+0000","last_fullsized":"2024-04-25T13:17:42.793142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.793018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.793018+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.793018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:23.367969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.140273+0000","last_change":"2024-04-25T13:17:44.140296+0000","last_active":"2024-04-25T13:17:44.140273+0000","last_peered":"2024-04-25T13:17:44.140273+0000","last_clean":"2024-04-25T13:17:44.140273+0000","last_became_active":"2024-04-25T13:16:10.236831+0000","last_became_peered":"2024-04-25T13:16:10.236831+0000","last_unstale":"2024-04-25T13:17:44.140273+0000","last_undegraded":"2024-04-25T13:17:44.140273+0000","last_fullsized":"2024-04-25T13:17:44.140273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.140190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.140190+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.140190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:50.177105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.424692+0000","last_change":"2024-04-25T13:17:29.424717+0000","last_active":"2024-04-25T13:17:29.424692+0000","last_peered":"2024-04-25T13:17:29.424692+0000","last_clean":"2024-04-25T13:17:29.424692+0000","last_became_active":"2024-04-25T13:16:09.222436+0000","last_became_peered":"2024-04-25T13:16:09.222436+0000","last_unstale":"2024-04-25T13:17:29.424692+0000","last_undegraded":"2024-04-25T13:17:29.424692+0000","last_fullsized":"2024-04-25T13:17:29.424692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:29.424615+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:29.424615+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.424615+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:23.849874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.144331+0000","last_change":"2024-04-25T13:17:45.144375+0000","last_active":"2024-04-25T13:17:45.144331+0000","last_peered":"2024-04-25T13:17:45.144331+0000","last_clean":"2024-04-25T13:17:45.144331+0000","last_became_active":"2024-04-25T13:16:14.256523+0000","last_became_peered":"2024-04-25T13:16:14.256523+0000","last_unstale":"2024-04-25T13:17:45.144331+0000","last_undegraded":"2024-04-25T13:17:45.144331+0000","last_fullsized":"2024-04-25T13:17:45.144331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.144217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.144217+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.144217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:52.381740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.170277+0000","last_change":"2024-04-25T13:17:43.170326+0000","last_active":"2024-04-25T13:17:43.170277+0000","last_peered":"2024-04-25T13:17:43.170277+0000","last_clean":"2024-04-25T13:17:43.170277+0000","last_became_active":"2024-04-25T13:16:10.236895+0000","last_became_peered":"2024-04-25T13:16:10.236895+0000","last_unstale":"2024-04-25T13:17:43.170277+0000","last_undegraded":"2024-04-25T13:17:43.170277+0000","last_fullsized":"2024-04-25T13:17:43.170277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.170178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.170178+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.170178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:54.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.532892+0000","last_change":"2024-04-25T13:17:28.532949+0000","last_active":"2024-04-25T13:17:28.532892+0000","last_peered":"2024-04-25T13:17:28.532892+0000","last_clean":"2024-04-25T13:17:28.532892+0000","last_became_active":"2024-04-25T13:16:09.230427+0000","last_became_peered":"2024-04-25T13:16:09.230427+0000","last_unstale":"2024-04-25T13:17:28.532892+0000","last_undegraded":"2024-04-25T13:17:28.532892+0000","last_fullsized":"2024-04-25T13:17:28.532892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:28.532796+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:28.532796+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.532796+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:55.384261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.613945+0000","last_change":"2024-04-25T13:17:38.613973+0000","last_active":"2024-04-25T13:17:38.613945+0000","last_peered":"2024-04-25T13:17:38.613945+0000","last_clean":"2024-04-25T13:17:38.613945+0000","last_became_active":"2024-04-25T13:16:14.259026+0000","last_became_peered":"2024-04-25T13:16:14.259026+0000","last_unstale":"2024-04-25T13:17:38.613945+0000","last_undegraded":"2024-04-25T13:17:38.613945+0000","last_fullsized":"2024-04-25T13:17:38.613945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.613857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.613857+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.613857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:47.182579+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.185878+0000","last_change":"2024-04-25T13:17:42.185918+0000","last_active":"2024-04-25T13:17:42.185878+0000","last_peered":"2024-04-25T13:17:42.185878+0000","last_clean":"2024-04-25T13:17:42.185878+0000","last_became_active":"2024-04-25T13:16:10.236362+0000","last_became_peered":"2024-04-25T13:16:10.236362+0000","last_unstale":"2024-04-25T13:17:42.185878+0000","last_undegraded":"2024-04-25T13:17:42.185878+0000","last_fullsized":"2024-04-25T13:17:42.185878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.185743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.185743+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.185743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:53.673307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'25","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.420765+0000","last_change":"2024-04-25T13:17:28.420807+0000","last_active":"2024-04-25T13:17:28.420765+0000","last_peered":"2024-04-25T13:17:28.420765+0000","last_clean":"2024-04-25T13:17:28.420765+0000","last_became_active":"2024-04-25T13:16:09.222660+0000","last_became_peered":"2024-04-25T13:16:09.222660+0000","last_unstale":"2024-04-25T13:17:28.420765+0000","last_undegraded":"2024-04-25T13:17:28.420765+0000","last_fullsized":"2024-04-25T13:17:28.420765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-25T13:17:28.420700+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-25T13:17:28.420700+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.420700+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:01.959645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.747861+0000","last_change":"2024-04-25T13:17:38.747891+0000","last_active":"2024-04-25T13:17:38.747861+0000","last_peered":"2024-04-25T13:17:38.747861+0000","last_clean":"2024-04-25T13:17:38.747861+0000","last_became_active":"2024-04-25T13:16:14.256603+0000","last_became_peered":"2024-04-25T13:16:14.256603+0000","last_unstale":"2024-04-25T13:17:38.747861+0000","last_undegraded":"2024-04-25T13:17:38.747861+0000","last_fullsized":"2024-04-25T13:17:38.747861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.747770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.747770+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.747770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:31.202218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.581354+0000","last_change":"2024-04-25T13:17:34.581377+0000","last_active":"2024-04-25T13:17:34.581354+0000","last_peered":"2024-04-25T13:17:34.581354+0000","last_clean":"2024-04-25T13:17:34.581354+0000","last_became_active":"2024-04-25T13:16:10.229126+0000","last_became_peered":"2024-04-25T13:16:10.229126+0000","last_unstale":"2024-04-25T13:17:34.581354+0000","last_undegraded":"2024-04-25T13:17:34.581354+0000","last_fullsized":"2024-04-25T13:17:34.581354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.581266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.581266+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.581266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:52.531392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.538658+0000","last_change":"2024-04-25T13:17:30.538692+0000","last_active":"2024-04-25T13:17:30.538658+0000","last_peered":"2024-04-25T13:17:30.538658+0000","last_clean":"2024-04-25T13:17:30.538658+0000","last_became_active":"2024-04-25T13:16:09.231899+0000","last_became_peered":"2024-04-25T13:16:09.231899+0000","last_unstale":"2024-04-25T13:17:30.538658+0000","last_undegraded":"2024-04-25T13:17:30.538658+0000","last_fullsized":"2024-04-25T13:17:30.538658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T13:17:30.538556+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T13:17:30.538556+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.538556+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:43.626190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.397972+0000","last_change":"2024-04-25T13:17:41.397998+0000","last_active":"2024-04-25T13:17:41.397972+0000","last_peered":"2024-04-25T13:17:41.397972+0000","last_clean":"2024-04-25T13:17:41.397972+0000","last_became_active":"2024-04-25T13:16:14.263632+0000","last_became_peered":"2024-04-25T13:16:14.263632+0000","last_unstale":"2024-04-25T13:17:41.397972+0000","last_undegraded":"2024-04-25T13:17:41.397972+0000","last_fullsized":"2024-04-25T13:17:41.397972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.397868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.397868+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.397868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:31.925761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.143415+0000","last_change":"2024-04-25T13:17:41.143443+0000","last_active":"2024-04-25T13:17:41.143415+0000","last_peered":"2024-04-25T13:17:41.143415+0000","last_clean":"2024-04-25T13:17:41.143415+0000","last_became_active":"2024-04-25T13:16:10.235776+0000","last_became_peered":"2024-04-25T13:16:10.235776+0000","last_unstale":"2024-04-25T13:17:41.143415+0000","last_undegraded":"2024-04-25T13:17:41.143415+0000","last_fullsized":"2024-04-25T13:17:41.143415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.143308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.143308+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.143308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:36.376309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.352851+0000","last_change":"2024-04-25T13:17:34.352894+0000","last_active":"2024-04-25T13:17:34.352851+0000","last_peered":"2024-04-25T13:17:34.352851+0000","last_clean":"2024-04-25T13:17:34.352851+0000","last_became_active":"2024-04-25T13:16:09.231224+0000","last_became_peered":"2024-04-25T13:16:09.231224+0000","last_unstale":"2024-04-25T13:17:34.352851+0000","last_undegraded":"2024-04-25T13:17:34.352851+0000","last_fullsized":"2024-04-25T13:17:34.352851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T13:17:34.352770+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T13:17:34.352770+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.352770+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:50.774058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.388869+0000","last_change":"2024-04-25T13:17:40.388915+0000","last_active":"2024-04-25T13:17:40.388869+0000","last_peered":"2024-04-25T13:17:40.388869+0000","last_clean":"2024-04-25T13:17:40.388869+0000","last_became_active":"2024-04-25T13:16:14.259416+0000","last_became_peered":"2024-04-25T13:16:14.259416+0000","last_unstale":"2024-04-25T13:17:40.388869+0000","last_undegraded":"2024-04-25T13:17:40.388869+0000","last_fullsized":"2024-04-25T13:17:40.388869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.388772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.388772+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.388772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:04.338463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.675401+0000","last_change":"2024-04-25T13:17:30.675426+0000","last_active":"2024-04-25T13:17:30.675401+0000","last_peered":"2024-04-25T13:17:30.675401+0000","last_clean":"2024-04-25T13:17:30.675401+0000","last_became_active":"2024-04-25T13:16:10.222282+0000","last_became_peered":"2024-04-25T13:16:10.222282+0000","last_unstale":"2024-04-25T13:17:30.675401+0000","last_undegraded":"2024-04-25T13:17:30.675401+0000","last_fullsized":"2024-04-25T13:17:30.675401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.675321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.675321+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.675321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:41.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'14","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.698564+0000","last_change":"2024-04-25T13:17:27.698594+0000","last_active":"2024-04-25T13:17:27.698564+0000","last_peered":"2024-04-25T13:17:27.698564+0000","last_clean":"2024-04-25T13:17:27.698564+0000","last_became_active":"2024-04-25T13:16:09.220636+0000","last_became_peered":"2024-04-25T13:16:09.220636+0000","last_unstale":"2024-04-25T13:17:27.698564+0000","last_undegraded":"2024-04-25T13:17:27.698564+0000","last_fullsized":"2024-04-25T13:17:27.698564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-04-25T13:17:27.698501+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-04-25T13:17:27.698501+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.698501+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:41.724475+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.116216+0000","last_change":"2024-04-25T13:17:46.116241+0000","last_active":"2024-04-25T13:17:46.116216+0000","last_peered":"2024-04-25T13:17:46.116216+0000","last_clean":"2024-04-25T13:17:46.116216+0000","last_became_active":"2024-04-25T13:16:14.266616+0000","last_became_peered":"2024-04-25T13:16:14.266616+0000","last_unstale":"2024-04-25T13:17:46.116216+0000","last_undegraded":"2024-04-25T13:17:46.116216+0000","last_fullsized":"2024-04-25T13:17:46.116216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.116120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.116120+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.116120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:52.703467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.094536+0000","last_change":"2024-04-25T13:17:40.094558+0000","last_active":"2024-04-25T13:17:40.094536+0000","last_peered":"2024-04-25T13:17:40.094536+0000","last_clean":"2024-04-25T13:17:40.094536+0000","last_became_active":"2024-04-25T13:16:10.234771+0000","last_became_peered":"2024-04-25T13:16:10.234771+0000","last_unstale":"2024-04-25T13:17:40.094536+0000","last_undegraded":"2024-04-25T13:17:40.094536+0000","last_fullsized":"2024-04-25T13:17:40.094536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.094439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.094439+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.094439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:55.391299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'20","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.520175+0000","last_change":"2024-04-25T13:17:29.520214+0000","last_active":"2024-04-25T13:17:29.520175+0000","last_peered":"2024-04-25T13:17:29.520175+0000","last_clean":"2024-04-25T13:17:29.520175+0000","last_became_active":"2024-04-25T13:16:09.228419+0000","last_became_peered":"2024-04-25T13:16:09.228419+0000","last_unstale":"2024-04-25T13:17:29.520175+0000","last_undegraded":"2024-04-25T13:17:29.520175+0000","last_fullsized":"2024-04-25T13:17:29.520175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-25T13:17:29.520071+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-25T13:17:29.520071+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.520071+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.505888+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.153986+0000","last_change":"2024-04-25T13:17:40.154030+0000","last_active":"2024-04-25T13:17:40.153986+0000","last_peered":"2024-04-25T13:17:40.153986+0000","last_clean":"2024-04-25T13:17:40.153986+0000","last_became_active":"2024-04-25T13:16:14.256909+0000","last_became_peered":"2024-04-25T13:16:14.256909+0000","last_unstale":"2024-04-25T13:17:40.153986+0000","last_undegraded":"2024-04-25T13:17:40.153986+0000","last_fullsized":"2024-04-25T13:17:40.153986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.153859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.153859+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.153859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:00.078915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.642220+0000","last_change":"2024-04-25T13:17:31.642248+0000","last_active":"2024-04-25T13:17:31.642220+0000","last_peered":"2024-04-25T13:17:31.642220+0000","last_clean":"2024-04-25T13:17:31.642220+0000","last_became_active":"2024-04-25T13:16:10.229174+0000","last_became_peered":"2024-04-25T13:16:10.229174+0000","last_unstale":"2024-04-25T13:17:31.642220+0000","last_undegraded":"2024-04-25T13:17:31.642220+0000","last_fullsized":"2024-04-25T13:17:31.642220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.642129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.642129+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.642129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:31.887393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.055478+0000","last_change":"2024-04-25T13:17:32.055513+0000","last_active":"2024-04-25T13:17:32.055478+0000","last_peered":"2024-04-25T13:17:32.055478+0000","last_clean":"2024-04-25T13:17:32.055478+0000","last_became_active":"2024-04-25T13:16:09.229191+0000","last_became_peered":"2024-04-25T13:16:09.229191+0000","last_unstale":"2024-04-25T13:17:32.055478+0000","last_undegraded":"2024-04-25T13:17:32.055478+0000","last_fullsized":"2024-04-25T13:17:32.055478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T13:17:32.055395+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T13:17:32.055395+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.055395+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:11.577858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.634038+0000","last_change":"2024-04-25T13:17:34.634069+0000","last_active":"2024-04-25T13:17:34.634038+0000","last_peered":"2024-04-25T13:17:34.634038+0000","last_clean":"2024-04-25T13:17:34.634038+0000","last_became_active":"2024-04-25T13:16:14.254130+0000","last_became_peered":"2024-04-25T13:16:14.254130+0000","last_unstale":"2024-04-25T13:17:34.634038+0000","last_undegraded":"2024-04-25T13:17:34.634038+0000","last_fullsized":"2024-04-25T13:17:34.634038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.633930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.633930+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.633930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:39.391072+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.713033+0000","last_change":"2024-04-25T13:17:36.713055+0000","last_active":"2024-04-25T13:17:36.713033+0000","last_peered":"2024-04-25T13:17:36.713033+0000","last_clean":"2024-04-25T13:17:36.713033+0000","last_became_active":"2024-04-25T13:16:10.236420+0000","last_became_peered":"2024-04-25T13:16:10.236420+0000","last_unstale":"2024-04-25T13:17:36.713033+0000","last_undegraded":"2024-04-25T13:17:36.713033+0000","last_fullsized":"2024-04-25T13:17:36.713033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.712949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.712949+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.712949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:31.805066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.374832+0000","last_change":"2024-04-25T13:17:35.374868+0000","last_active":"2024-04-25T13:17:35.374832+0000","last_peered":"2024-04-25T13:17:35.374832+0000","last_clean":"2024-04-25T13:17:35.374832+0000","last_became_active":"2024-04-25T13:16:09.232803+0000","last_became_peered":"2024-04-25T13:16:09.232803+0000","last_unstale":"2024-04-25T13:17:35.374832+0000","last_undegraded":"2024-04-25T13:17:35.374832+0000","last_fullsized":"2024-04-25T13:17:35.374832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T13:17:35.374748+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T13:17:35.374748+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.374748+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:02.226212+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.311312+0000","last_change":"2024-04-25T13:17:44.311343+0000","last_active":"2024-04-25T13:17:44.311312+0000","last_peered":"2024-04-25T13:17:44.311312+0000","last_clean":"2024-04-25T13:17:44.311312+0000","last_became_active":"2024-04-25T13:16:14.263834+0000","last_became_peered":"2024-04-25T13:16:14.263834+0000","last_unstale":"2024-04-25T13:17:44.311312+0000","last_undegraded":"2024-04-25T13:17:44.311312+0000","last_fullsized":"2024-04-25T13:17:44.311312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.311218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.311218+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.311218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:45.799961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.186962+0000","last_change":"2024-04-25T13:17:42.186986+0000","last_active":"2024-04-25T13:17:42.186962+0000","last_peered":"2024-04-25T13:17:42.186962+0000","last_clean":"2024-04-25T13:17:42.186962+0000","last_became_active":"2024-04-25T13:16:10.240773+0000","last_became_peered":"2024-04-25T13:16:10.240773+0000","last_unstale":"2024-04-25T13:17:42.186962+0000","last_undegraded":"2024-04-25T13:17:42.186962+0000","last_fullsized":"2024-04-25T13:17:42.186962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.186885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.186885+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.186885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:07.144530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.500832+0000","last_change":"2024-04-25T13:17:32.500864+0000","last_active":"2024-04-25T13:17:32.500832+0000","last_peered":"2024-04-25T13:17:32.500832+0000","last_clean":"2024-04-25T13:17:32.500832+0000","last_became_active":"2024-04-25T13:16:09.234520+0000","last_became_peered":"2024-04-25T13:16:09.234520+0000","last_unstale":"2024-04-25T13:17:32.500832+0000","last_undegraded":"2024-04-25T13:17:32.500832+0000","last_fullsized":"2024-04-25T13:17:32.500832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T13:17:32.500734+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T13:17:32.500734+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.500734+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:20.591471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.367045+0000","last_change":"2024-04-25T13:17:42.367074+0000","last_active":"2024-04-25T13:17:42.367045+0000","last_peered":"2024-04-25T13:17:42.367045+0000","last_clean":"2024-04-25T13:17:42.367045+0000","last_became_active":"2024-04-25T13:16:14.264005+0000","last_became_peered":"2024-04-25T13:16:14.264005+0000","last_unstale":"2024-04-25T13:17:42.367045+0000","last_undegraded":"2024-04-25T13:17:42.367045+0000","last_fullsized":"2024-04-25T13:17:42.367045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.366953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.366953+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.366953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:31.913857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.731190+0000","last_change":"2024-04-25T13:17:40.731220+0000","last_active":"2024-04-25T13:17:40.731190+0000","last_peered":"2024-04-25T13:17:40.731190+0000","last_clean":"2024-04-25T13:17:40.731190+0000","last_became_active":"2024-04-25T13:16:14.258741+0000","last_became_peered":"2024-04-25T13:16:14.258741+0000","last_unstale":"2024-04-25T13:17:40.731190+0000","last_undegraded":"2024-04-25T13:17:40.731190+0000","last_fullsized":"2024-04-25T13:17:40.731190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.731099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.731099+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.731099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:17.590493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.096359+0000","last_change":"2024-04-25T13:17:37.096397+0000","last_active":"2024-04-25T13:17:37.096359+0000","last_peered":"2024-04-25T13:17:37.096359+0000","last_clean":"2024-04-25T13:17:37.096359+0000","last_became_active":"2024-04-25T13:16:10.231646+0000","last_became_peered":"2024-04-25T13:16:10.231646+0000","last_unstale":"2024-04-25T13:17:37.096359+0000","last_undegraded":"2024-04-25T13:17:37.096359+0000","last_fullsized":"2024-04-25T13:17:37.096359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.096237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.096237+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.096237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:07.866051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.352773+0000","last_change":"2024-04-25T13:17:31.352800+0000","last_active":"2024-04-25T13:17:31.352773+0000","last_peered":"2024-04-25T13:17:31.352773+0000","last_clean":"2024-04-25T13:17:31.352773+0000","last_became_active":"2024-04-25T13:16:09.226075+0000","last_became_peered":"2024-04-25T13:16:09.226075+0000","last_unstale":"2024-04-25T13:17:31.352773+0000","last_undegraded":"2024-04-25T13:17:31.352773+0000","last_fullsized":"2024-04-25T13:17:31.352773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T13:17:31.352688+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T13:17:31.352688+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.352688+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:34.013004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.710089+0000","last_change":"2024-04-25T13:17:41.710114+0000","last_active":"2024-04-25T13:17:41.710089+0000","last_peered":"2024-04-25T13:17:41.710089+0000","last_clean":"2024-04-25T13:17:41.710089+0000","last_became_active":"2024-04-25T13:16:14.253122+0000","last_became_peered":"2024-04-25T13:16:14.253122+0000","last_unstale":"2024-04-25T13:17:41.710089+0000","last_undegraded":"2024-04-25T13:17:41.710089+0000","last_fullsized":"2024-04-25T13:17:41.710089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.710002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.710002+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.710002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:31.147852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.345816+0000","last_change":"2024-04-25T13:17:36.345853+0000","last_active":"2024-04-25T13:17:36.345816+0000","last_peered":"2024-04-25T13:17:36.345816+0000","last_clean":"2024-04-25T13:17:36.345816+0000","last_became_active":"2024-04-25T13:16:50.370143+0000","last_became_peered":"2024-04-25T13:16:50.370143+0000","last_unstale":"2024-04-25T13:17:36.345816+0000","last_undegraded":"2024-04-25T13:17:36.345816+0000","last_fullsized":"2024-04-25T13:17:36.345816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.345678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.345678+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.345678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:38.072783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.322276+0000","last_change":"2024-04-25T13:17:33.322323+0000","last_active":"2024-04-25T13:17:33.322276+0000","last_peered":"2024-04-25T13:17:33.322276+0000","last_clean":"2024-04-25T13:17:33.322276+0000","last_became_active":"2024-04-25T13:16:09.232796+0000","last_became_peered":"2024-04-25T13:16:09.232796+0000","last_unstale":"2024-04-25T13:17:33.322276+0000","last_undegraded":"2024-04-25T13:17:33.322276+0000","last_fullsized":"2024-04-25T13:17:33.322276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T13:17:33.322197+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T13:17:33.322197+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.322197+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.135059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.507889+0000","last_change":"2024-04-25T13:17:31.507923+0000","last_active":"2024-04-25T13:17:31.507889+0000","last_peered":"2024-04-25T13:17:31.507889+0000","last_clean":"2024-04-25T13:17:31.507889+0000","last_became_active":"2024-04-25T13:16:09.232719+0000","last_became_peered":"2024-04-25T13:16:09.232719+0000","last_unstale":"2024-04-25T13:17:31.507889+0000","last_undegraded":"2024-04-25T13:17:31.507889+0000","last_fullsized":"2024-04-25T13:17:31.507889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T13:17:31.507809+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T13:17:31.507809+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.507809+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.450513+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.689088+0000","last_change":"2024-04-25T13:17:35.689116+0000","last_active":"2024-04-25T13:17:35.689088+0000","last_peered":"2024-04-25T13:17:35.689088+0000","last_clean":"2024-04-25T13:17:35.689088+0000","last_became_active":"2024-04-25T13:16:10.232556+0000","last_became_peered":"2024-04-25T13:16:10.232556+0000","last_unstale":"2024-04-25T13:17:35.689088+0000","last_undegraded":"2024-04-25T13:17:35.689088+0000","last_fullsized":"2024-04-25T13:17:35.689088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.688996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.688996+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.688996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:08.072465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.407035+0000","last_change":"2024-04-25T13:17:33.407063+0000","last_active":"2024-04-25T13:17:33.407035+0000","last_peered":"2024-04-25T13:17:33.407035+0000","last_clean":"2024-04-25T13:17:33.407035+0000","last_became_active":"2024-04-25T13:16:14.265923+0000","last_became_peered":"2024-04-25T13:16:14.265923+0000","last_unstale":"2024-04-25T13:17:33.407035+0000","last_undegraded":"2024-04-25T13:17:33.407035+0000","last_fullsized":"2024-04-25T13:17:33.407035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.406948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.406948+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.406948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:02.397854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.272687+0000","last_change":"2024-04-25T13:17:32.272726+0000","last_active":"2024-04-25T13:17:32.272687+0000","last_peered":"2024-04-25T13:17:32.272687+0000","last_clean":"2024-04-25T13:17:32.272687+0000","last_became_active":"2024-04-25T13:16:09.228123+0000","last_became_peered":"2024-04-25T13:16:09.228123+0000","last_unstale":"2024-04-25T13:17:32.272687+0000","last_undegraded":"2024-04-25T13:17:32.272687+0000","last_fullsized":"2024-04-25T13:17:32.272687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T13:17:32.272591+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T13:17:32.272591+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.272591+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:22.929964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.611060+0000","last_change":"2024-04-25T13:17:30.611105+0000","last_active":"2024-04-25T13:17:30.611060+0000","last_peered":"2024-04-25T13:17:30.611060+0000","last_clean":"2024-04-25T13:17:30.611060+0000","last_became_active":"2024-04-25T13:16:10.227459+0000","last_became_peered":"2024-04-25T13:16:10.227459+0000","last_unstale":"2024-04-25T13:17:30.611060+0000","last_undegraded":"2024-04-25T13:17:30.611060+0000","last_fullsized":"2024-04-25T13:17:30.611060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.610965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.610965+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.610965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:52.713413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.301661+0000","last_change":"2024-04-25T13:17:45.301705+0000","last_active":"2024-04-25T13:17:45.301661+0000","last_peered":"2024-04-25T13:17:45.301661+0000","last_clean":"2024-04-25T13:17:45.301661+0000","last_became_active":"2024-04-25T13:16:14.269009+0000","last_became_peered":"2024-04-25T13:16:14.269009+0000","last_unstale":"2024-04-25T13:17:45.301661+0000","last_undegraded":"2024-04-25T13:17:45.301661+0000","last_fullsized":"2024-04-25T13:17:45.301661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.301543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.301543+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.301543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:35.098910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.571885+0000","last_change":"2024-04-25T13:17:35.571922+0000","last_active":"2024-04-25T13:17:35.571885+0000","last_peered":"2024-04-25T13:17:35.571885+0000","last_clean":"2024-04-25T13:17:35.571885+0000","last_became_active":"2024-04-25T13:16:10.232102+0000","last_became_peered":"2024-04-25T13:16:10.232102+0000","last_unstale":"2024-04-25T13:17:35.571885+0000","last_undegraded":"2024-04-25T13:17:35.571885+0000","last_fullsized":"2024-04-25T13:17:35.571885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.571780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.571780+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.571780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:06.362005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.389459+0000","last_change":"2024-04-25T13:17:32.389484+0000","last_active":"2024-04-25T13:17:32.389459+0000","last_peered":"2024-04-25T13:17:32.389459+0000","last_clean":"2024-04-25T13:17:32.389459+0000","last_became_active":"2024-04-25T13:16:10.234321+0000","last_became_peered":"2024-04-25T13:16:10.234321+0000","last_unstale":"2024-04-25T13:17:32.389459+0000","last_undegraded":"2024-04-25T13:17:32.389459+0000","last_fullsized":"2024-04-25T13:17:32.389459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.389377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.389377+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.389377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:22.479812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.303931+0000","last_change":"2024-04-25T13:17:28.303957+0000","last_active":"2024-04-25T13:17:28.303931+0000","last_peered":"2024-04-25T13:17:28.303931+0000","last_clean":"2024-04-25T13:17:28.303931+0000","last_became_active":"2024-04-25T13:16:10.236042+0000","last_became_peered":"2024-04-25T13:16:10.236042+0000","last_unstale":"2024-04-25T13:17:28.303931+0000","last_undegraded":"2024-04-25T13:17:28.303931+0000","last_fullsized":"2024-04-25T13:17:28.303931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.303847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.303847+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.303847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:24.404404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.645957+0000","last_change":"2024-04-25T13:17:34.645981+0000","last_active":"2024-04-25T13:17:34.645957+0000","last_peered":"2024-04-25T13:17:34.645957+0000","last_clean":"2024-04-25T13:17:34.645957+0000","last_became_active":"2024-04-25T13:16:10.229215+0000","last_became_peered":"2024-04-25T13:16:10.229215+0000","last_unstale":"2024-04-25T13:17:34.645957+0000","last_undegraded":"2024-04-25T13:17:34.645957+0000","last_fullsized":"2024-04-25T13:17:34.645957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.645868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.645868+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.645868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:35.968793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.367307+0000","last_change":"2024-04-25T13:17:34.367334+0000","last_active":"2024-04-25T13:17:34.367307+0000","last_peered":"2024-04-25T13:17:34.367307+0000","last_clean":"2024-04-25T13:17:34.367307+0000","last_became_active":"2024-04-25T13:16:50.369437+0000","last_became_peered":"2024-04-25T13:16:50.369437+0000","last_unstale":"2024-04-25T13:17:34.367307+0000","last_undegraded":"2024-04-25T13:17:34.367307+0000","last_fullsized":"2024-04-25T13:17:34.367307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.367232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.367232+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.367232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:47.773508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.084378+0000","last_change":"2024-04-25T13:17:36.084405+0000","last_active":"2024-04-25T13:17:36.084378+0000","last_peered":"2024-04-25T13:17:36.084378+0000","last_clean":"2024-04-25T13:17:36.084378+0000","last_became_active":"2024-04-25T13:16:10.230334+0000","last_became_peered":"2024-04-25T13:16:10.230334+0000","last_unstale":"2024-04-25T13:17:36.084378+0000","last_undegraded":"2024-04-25T13:17:36.084378+0000","last_fullsized":"2024-04-25T13:17:36.084378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.084272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.084272+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.084272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:01.014556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.615894+0000","last_change":"2024-04-25T13:17:36.615920+0000","last_active":"2024-04-25T13:17:36.615894+0000","last_peered":"2024-04-25T13:17:36.615894+0000","last_clean":"2024-04-25T13:17:36.615894+0000","last_became_active":"2024-04-25T13:16:10.233671+0000","last_became_peered":"2024-04-25T13:16:10.233671+0000","last_unstale":"2024-04-25T13:17:36.615894+0000","last_undegraded":"2024-04-25T13:17:36.615894+0000","last_fullsized":"2024-04-25T13:17:36.615894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.615809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.615809+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.615809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:45.830710+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.280778+0000","last_change":"2024-04-25T13:17:30.280801+0000","last_active":"2024-04-25T13:17:30.280778+0000","last_peered":"2024-04-25T13:17:30.280778+0000","last_clean":"2024-04-25T13:17:30.280778+0000","last_became_active":"2024-04-25T13:16:10.236126+0000","last_became_peered":"2024-04-25T13:16:10.236126+0000","last_unstale":"2024-04-25T13:17:30.280778+0000","last_undegraded":"2024-04-25T13:17:30.280778+0000","last_fullsized":"2024-04-25T13:17:30.280778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.280693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.280693+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.280693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:49.230129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.211441+0000","last_change":"2024-04-25T13:17:41.211466+0000","last_active":"2024-04-25T13:17:41.211441+0000","last_peered":"2024-04-25T13:17:41.211441+0000","last_clean":"2024-04-25T13:17:41.211441+0000","last_became_active":"2024-04-25T13:16:10.238672+0000","last_became_peered":"2024-04-25T13:16:10.238672+0000","last_unstale":"2024-04-25T13:17:41.211441+0000","last_undegraded":"2024-04-25T13:17:41.211441+0000","last_fullsized":"2024-04-25T13:17:41.211441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.211360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.211360+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.211360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:30.751041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.229410+0000","last_change":"2024-04-25T13:17:28.229445+0000","last_active":"2024-04-25T13:17:28.229410+0000","last_peered":"2024-04-25T13:17:28.229410+0000","last_clean":"2024-04-25T13:17:28.229410+0000","last_became_active":"2024-04-25T13:16:10.236585+0000","last_became_peered":"2024-04-25T13:16:10.236585+0000","last_unstale":"2024-04-25T13:17:28.229410+0000","last_undegraded":"2024-04-25T13:17:28.229410+0000","last_fullsized":"2024-04-25T13:17:28.229410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.229301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.229301+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.229301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:30.289458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.319615+0000","last_change":"2024-04-25T13:17:37.319655+0000","last_active":"2024-04-25T13:17:37.319615+0000","last_peered":"2024-04-25T13:17:37.319615+0000","last_clean":"2024-04-25T13:17:37.319615+0000","last_became_active":"2024-04-25T13:16:10.233093+0000","last_became_peered":"2024-04-25T13:16:10.233093+0000","last_unstale":"2024-04-25T13:17:37.319615+0000","last_undegraded":"2024-04-25T13:17:37.319615+0000","last_fullsized":"2024-04-25T13:17:37.319615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.319529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.319529+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.319529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:39.688909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.639557+0000","last_change":"2024-04-25T13:17:26.639577+0000","last_active":"2024-04-25T13:17:26.639557+0000","last_peered":"2024-04-25T13:17:26.639557+0000","last_clean":"2024-04-25T13:17:26.639557+0000","last_became_active":"2024-04-25T13:16:10.230003+0000","last_became_peered":"2024-04-25T13:16:10.230003+0000","last_unstale":"2024-04-25T13:17:26.639557+0000","last_undegraded":"2024-04-25T13:17:26.639557+0000","last_fullsized":"2024-04-25T13:17:26.639557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.639492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.639492+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.639492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:02.561260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.603482+0000","last_change":"2024-04-25T13:17:38.603513+0000","last_active":"2024-04-25T13:17:38.603482+0000","last_peered":"2024-04-25T13:17:38.603482+0000","last_clean":"2024-04-25T13:17:38.603482+0000","last_became_active":"2024-04-25T13:16:10.236433+0000","last_became_peered":"2024-04-25T13:16:10.236433+0000","last_unstale":"2024-04-25T13:17:38.603482+0000","last_undegraded":"2024-04-25T13:17:38.603482+0000","last_fullsized":"2024-04-25T13:17:38.603482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.603384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.603384+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.603384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:21.373773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.091144+0000","last_change":"2024-04-25T13:17:38.091170+0000","last_active":"2024-04-25T13:17:38.091144+0000","last_peered":"2024-04-25T13:17:38.091144+0000","last_clean":"2024-04-25T13:17:38.091144+0000","last_became_active":"2024-04-25T13:16:10.228763+0000","last_became_peered":"2024-04-25T13:16:10.228763+0000","last_unstale":"2024-04-25T13:17:38.091144+0000","last_undegraded":"2024-04-25T13:17:38.091144+0000","last_fullsized":"2024-04-25T13:17:38.091144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.091048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.091048+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.091048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:33.571905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.404125+0000","last_change":"2024-04-25T13:17:31.404151+0000","last_active":"2024-04-25T13:17:31.404125+0000","last_peered":"2024-04-25T13:17:31.404125+0000","last_clean":"2024-04-25T13:17:31.404125+0000","last_became_active":"2024-04-25T13:16:10.232273+0000","last_became_peered":"2024-04-25T13:16:10.232273+0000","last_unstale":"2024-04-25T13:17:31.404125+0000","last_undegraded":"2024-04-25T13:17:31.404125+0000","last_fullsized":"2024-04-25T13:17:31.404125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.404043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.404043+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.404043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:26.159210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.277596+0000","last_change":"2024-04-25T13:17:38.277619+0000","last_active":"2024-04-25T13:17:38.277596+0000","last_peered":"2024-04-25T13:17:38.277596+0000","last_clean":"2024-04-25T13:17:38.277596+0000","last_became_active":"2024-04-25T13:16:10.233141+0000","last_became_peered":"2024-04-25T13:16:10.233141+0000","last_unstale":"2024-04-25T13:17:38.277596+0000","last_undegraded":"2024-04-25T13:17:38.277596+0000","last_fullsized":"2024-04-25T13:17:38.277596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.277515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.277515+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.277515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:04.349932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.312143+0000","last_change":"2024-04-25T13:17:30.312169+0000","last_active":"2024-04-25T13:17:30.312143+0000","last_peered":"2024-04-25T13:17:30.312143+0000","last_clean":"2024-04-25T13:17:30.312143+0000","last_became_active":"2024-04-25T13:16:10.234991+0000","last_became_peered":"2024-04-25T13:16:10.234991+0000","last_unstale":"2024-04-25T13:17:30.312143+0000","last_undegraded":"2024-04-25T13:17:30.312143+0000","last_fullsized":"2024-04-25T13:17:30.312143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.312058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.312058+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.312058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:29.952531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.100211+0000","last_change":"2024-04-25T13:17:38.100237+0000","last_active":"2024-04-25T13:17:38.100211+0000","last_peered":"2024-04-25T13:17:38.100211+0000","last_clean":"2024-04-25T13:17:38.100211+0000","last_became_active":"2024-04-25T13:16:10.236198+0000","last_became_peered":"2024-04-25T13:16:10.236198+0000","last_unstale":"2024-04-25T13:17:38.100211+0000","last_undegraded":"2024-04-25T13:17:38.100211+0000","last_fullsized":"2024-04-25T13:17:38.100211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.100124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.100124+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.100124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:02.103015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.664713+0000","last_change":"2024-04-25T13:17:32.664764+0000","last_active":"2024-04-25T13:17:32.664713+0000","last_peered":"2024-04-25T13:17:32.664713+0000","last_clean":"2024-04-25T13:17:32.664713+0000","last_became_active":"2024-04-25T13:16:10.225567+0000","last_became_peered":"2024-04-25T13:16:10.225567+0000","last_unstale":"2024-04-25T13:17:32.664713+0000","last_undegraded":"2024-04-25T13:17:32.664713+0000","last_fullsized":"2024-04-25T13:17:32.664713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.664594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.664594+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.664594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.964895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.272059+0000","last_change":"2024-04-25T13:17:36.272103+0000","last_active":"2024-04-25T13:17:36.272059+0000","last_peered":"2024-04-25T13:17:36.272059+0000","last_clean":"2024-04-25T13:17:36.272059+0000","last_became_active":"2024-04-25T13:16:10.234774+0000","last_became_peered":"2024-04-25T13:16:10.234774+0000","last_unstale":"2024-04-25T13:17:36.272059+0000","last_undegraded":"2024-04-25T13:17:36.272059+0000","last_fullsized":"2024-04-25T13:17:36.272059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.271954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.271954+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.271954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:48.130301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.655605+0000","last_change":"2024-04-25T13:17:32.655672+0000","last_active":"2024-04-25T13:17:32.655605+0000","last_peered":"2024-04-25T13:17:32.655605+0000","last_clean":"2024-04-25T13:17:32.655605+0000","last_became_active":"2024-04-25T13:16:10.230505+0000","last_became_peered":"2024-04-25T13:16:10.230505+0000","last_unstale":"2024-04-25T13:17:32.655605+0000","last_undegraded":"2024-04-25T13:17:32.655605+0000","last_fullsized":"2024-04-25T13:17:32.655605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.655481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.655481+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.655481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.116872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.619464+0000","last_change":"2024-04-25T13:17:39.619491+0000","last_active":"2024-04-25T13:17:39.619464+0000","last_peered":"2024-04-25T13:17:39.619464+0000","last_clean":"2024-04-25T13:17:39.619464+0000","last_became_active":"2024-04-25T13:16:10.238277+0000","last_became_peered":"2024-04-25T13:16:10.238277+0000","last_unstale":"2024-04-25T13:17:39.619464+0000","last_undegraded":"2024-04-25T13:17:39.619464+0000","last_fullsized":"2024-04-25T13:17:39.619464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.619369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.619369+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.619369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:03.702175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.660906+0000","last_change":"2024-04-25T13:17:40.660930+0000","last_active":"2024-04-25T13:17:40.660906+0000","last_peered":"2024-04-25T13:17:40.660906+0000","last_clean":"2024-04-25T13:17:40.660906+0000","last_became_active":"2024-04-25T13:16:10.239202+0000","last_became_peered":"2024-04-25T13:16:10.239202+0000","last_unstale":"2024-04-25T13:17:40.660906+0000","last_undegraded":"2024-04-25T13:17:40.660906+0000","last_fullsized":"2024-04-25T13:17:40.660906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.660822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.660822+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.660822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:33.194608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.133771+0000","last_change":"2024-04-25T13:17:45.133809+0000","last_active":"2024-04-25T13:17:45.133771+0000","last_peered":"2024-04-25T13:17:45.133771+0000","last_clean":"2024-04-25T13:17:45.133771+0000","last_became_active":"2024-04-25T13:16:50.365415+0000","last_became_peered":"2024-04-25T13:16:50.365415+0000","last_unstale":"2024-04-25T13:17:45.133771+0000","last_undegraded":"2024-04-25T13:17:45.133771+0000","last_fullsized":"2024-04-25T13:17:45.133771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.133663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.133663+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.133663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.233922+0000","last_change":"2024-04-25T13:17:29.233943+0000","last_active":"2024-04-25T13:17:29.233922+0000","last_peered":"2024-04-25T13:17:29.233922+0000","last_clean":"2024-04-25T13:17:29.233922+0000","last_became_active":"2024-04-25T13:16:10.239897+0000","last_became_peered":"2024-04-25T13:16:10.239897+0000","last_unstale":"2024-04-25T13:17:29.233922+0000","last_undegraded":"2024-04-25T13:17:29.233922+0000","last_fullsized":"2024-04-25T13:17:29.233922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.233845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.233845+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.233845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:35.999883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.334032+0000","last_change":"2024-04-25T13:17:35.334100+0000","last_active":"2024-04-25T13:17:35.334032+0000","last_peered":"2024-04-25T13:17:35.334032+0000","last_clean":"2024-04-25T13:17:35.334032+0000","last_became_active":"2024-04-25T13:16:50.370066+0000","last_became_peered":"2024-04-25T13:16:50.370066+0000","last_unstale":"2024-04-25T13:17:35.334032+0000","last_undegraded":"2024-04-25T13:17:35.334032+0000","last_fullsized":"2024-04-25T13:17:35.334032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.333942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.333942+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.333942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:24.507257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.338456+0000","last_change":"2024-04-25T13:17:36.338488+0000","last_active":"2024-04-25T13:17:36.338456+0000","last_peered":"2024-04-25T13:17:36.338456+0000","last_clean":"2024-04-25T13:17:36.338456+0000","last_became_active":"2024-04-25T13:16:10.230959+0000","last_became_peered":"2024-04-25T13:16:10.230959+0000","last_unstale":"2024-04-25T13:17:36.338456+0000","last_undegraded":"2024-04-25T13:17:36.338456+0000","last_fullsized":"2024-04-25T13:17:36.338456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.338371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.338371+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.338371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:28.599953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.179999+0000","last_change":"2024-04-25T13:17:30.180026+0000","last_active":"2024-04-25T13:17:30.179999+0000","last_peered":"2024-04-25T13:17:30.179999+0000","last_clean":"2024-04-25T13:17:30.179999+0000","last_became_active":"2024-04-25T13:16:10.228740+0000","last_became_peered":"2024-04-25T13:16:10.228740+0000","last_unstale":"2024-04-25T13:17:30.179999+0000","last_undegraded":"2024-04-25T13:17:30.179999+0000","last_fullsized":"2024-04-25T13:17:30.179999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.179905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.179905+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.179905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:39.946829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.242973+0000","last_change":"2024-04-25T13:17:40.242998+0000","last_active":"2024-04-25T13:17:40.242973+0000","last_peered":"2024-04-25T13:17:40.242973+0000","last_clean":"2024-04-25T13:17:40.242973+0000","last_became_active":"2024-04-25T13:16:10.237618+0000","last_became_peered":"2024-04-25T13:16:10.237618+0000","last_unstale":"2024-04-25T13:17:40.242973+0000","last_undegraded":"2024-04-25T13:17:40.242973+0000","last_fullsized":"2024-04-25T13:17:40.242973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.242883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.242883+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.242883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:32.205878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.691816+0000","last_change":"2024-04-25T13:17:29.691861+0000","last_active":"2024-04-25T13:17:29.691816+0000","last_peered":"2024-04-25T13:17:29.691816+0000","last_clean":"2024-04-25T13:17:29.691816+0000","last_became_active":"2024-04-25T13:16:10.221044+0000","last_became_peered":"2024-04-25T13:16:10.221044+0000","last_unstale":"2024-04-25T13:17:29.691816+0000","last_undegraded":"2024-04-25T13:17:29.691816+0000","last_fullsized":"2024-04-25T13:17:29.691816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.691732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.691732+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.691732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:10.916700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.057888+0000","last_change":"2024-04-25T13:17:35.057914+0000","last_active":"2024-04-25T13:17:35.057888+0000","last_peered":"2024-04-25T13:17:35.057888+0000","last_clean":"2024-04-25T13:17:35.057888+0000","last_became_active":"2024-04-25T13:16:10.225552+0000","last_became_peered":"2024-04-25T13:16:10.225552+0000","last_unstale":"2024-04-25T13:17:35.057888+0000","last_undegraded":"2024-04-25T13:17:35.057888+0000","last_fullsized":"2024-04-25T13:17:35.057888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.057799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.057799+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.057799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:29.451792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.117323+0000","last_change":"2024-04-25T13:17:39.117346+0000","last_active":"2024-04-25T13:17:39.117323+0000","last_peered":"2024-04-25T13:17:39.117323+0000","last_clean":"2024-04-25T13:17:39.117323+0000","last_became_active":"2024-04-25T13:16:10.233234+0000","last_became_peered":"2024-04-25T13:16:10.233234+0000","last_unstale":"2024-04-25T13:17:39.117323+0000","last_undegraded":"2024-04-25T13:17:39.117323+0000","last_fullsized":"2024-04-25T13:17:39.117323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.117237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.117237+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.117237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:43.899259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":14,"seq":60129542173,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":120093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:18:10.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T13:18:10.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.346+0000 7fbad4930640 1 Processor -- start 2024-04-25T13:18:10.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.347+0000 7fbad4930640 1 -- start start 2024-04-25T13:18:10.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.347+0000 7fbad4930640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbad00cae40 0x7fbad015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.347+0000 7fbad4930640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.347+0000 7fbad4930640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad006fa90 con 0x7fbad00cb5c0 2024-04-25T13:18:10.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.347+0000 7fbad4930640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbad006fd30 con 0x7fbad00cae40 2024-04-25T13:18:10.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.347+0000 7fbad4930640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbad00c9d90 con 0x7fbad00cb9a0 2024-04-25T13:18:10.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbacdd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbad00cae40 0x7fbad015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbacdd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbad00cae40 0x7fbad015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58676/0 (socket says 172.21.15.26:58676) 2024-04-25T13:18:10.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbacdd9b640 1 -- 172.21.15.26:0/437444804 learned_addr learned my addr 172.21.15.26:0/437444804 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:10.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbaced9d640 1 --2- 172.21.15.26:0/437444804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbacdd9b640 1 -- 172.21.15.26:0/437444804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 msgr2=0x7fbad015b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:10.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbacdd9b640 1 --2- 172.21.15.26:0/437444804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad015b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbacdd9b640 1 -- 172.21.15.26:0/437444804 >> v1:172.21.15.169:6789/0 conn(0x7fbad00cb5c0 legacy=0x7fbad006f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:10.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.348+0000 7fbacdd9b640 1 -- 172.21.15.26:0/437444804 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad00ca070 con 0x7fbad00cae40 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbacdd9b640 1 --2- 172.21.15.26:0/437444804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cae40 0x7fbad015b1e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbac40098a0 tx=0x7fbac402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5cdcb317cac6db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbacd59a640 1 -- 172.21.15.26:0/437444804 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4037070 con 0x7fbad00cae40 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbacd59a640 1 -- 172.21.15.26:0/437444804 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac4032440 con 0x7fbad00cae40 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbacd59a640 1 -- 172.21.15.26:0/437444804 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4032810 con 0x7fbad00cae40 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbad4930640 1 -- 172.21.15.26:0/437444804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cae40 msgr2=0x7fbad015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbad4930640 1 --2- 172.21.15.26:0/437444804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cae40 0x7fbad015b1e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbac40098a0 tx=0x7fbac402a290 comp rx=0 tx=0).stop 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbad4930640 1 -- 172.21.15.26:0/437444804 shutdown_connections 2024-04-25T13:18:10.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbad4930640 1 --2- 172.21.15.26:0/437444804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbad4930640 1 --2- 172.21.15.26:0/437444804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cae40 0x7fbad015b1e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbad4930640 1 -- 172.21.15.26:0/437444804 >> 172.21.15.26:0/437444804 conn(0x7fbad0074d50 msgr2=0x7fbad0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:10.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.349+0000 7fbad4930640 1 -- 172.21.15.26:0/437444804 shutdown_connections 2024-04-25T13:18:10.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.350+0000 7fbad4930640 1 -- 172.21.15.26:0/437444804 wait complete. 2024-04-25T13:18:10.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 Processor -- start 2024-04-25T13:18:10.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 -- start start 2024-04-25T13:18:10.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad00cae40 0x7fbad0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cb5c0 0x7fbad00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad00cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbad00ca910 con 0x7fbad00cb5c0 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbad00ca630 con 0x7fbad00cae40 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.351+0000 7fbad4930640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbad006c450 con 0x7fbad00cb9a0 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cb5c0 0x7fbad00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cb5c0 0x7fbad00ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58680/0 (socket says 172.21.15.26:58680) 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 -- 172.21.15.26:0/3200800015 learned_addr learned my addr 172.21.15.26:0/3200800015 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbaced9d640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad00cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbace59c640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad00cae40 0x7fbad0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 -- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 msgr2=0x7fbad00cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad00cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 -- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad00cae40 msgr2=0x7fbad0150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad00cae40 0x7fbad0150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 -- 172.21.15.26:0/3200800015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad01f1810 con 0x7fbad00cb5c0 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbace59c640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad00cae40 0x7fbad0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbacdd9b640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cb5c0 0x7fbad00ccbc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbac40099c0 tx=0x7fbac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4041020 con 0x7fbad00cb5c0 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac40306c0 con 0x7fbad00cb5c0 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad00cc6c0 con 0x7fbad00cb5c0 2024-04-25T13:18:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4037040 con 0x7fbad00cb5c0 2024-04-25T13:18:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.352+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad00cf2f0 con 0x7fbad00cb5c0 2024-04-25T13:18:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.353+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad0068f50 con 0x7fbad00cb5c0 2024-04-25T13:18:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.354+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbac4044020 con 0x7fbad00cb5c0 2024-04-25T13:18:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.354+0000 7fbabeffd640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbab006c8f0 0x7fbab006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.354+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fbac40ac780 con 0x7fbad00cb5c0 2024-04-25T13:18:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.354+0000 7fbace59c640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbab006c8f0 0x7fbab006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.355+0000 7fbace59c640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbab006c8f0 0x7fbab006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbac0007fd0 tx=0x7fbac0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:10.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.358+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbac404b030 con 0x7fbad00cb5c0 2024-04-25T13:18:10.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.549+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbad00cf690 con 0x7fbad00cb5c0 2024-04-25T13:18:10.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.552+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fbac407a770 con 0x7fbad00cb5c0 2024-04-25T13:18:10.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.553+0000 7fbabeffd640 1 -- 172.21.15.26:0/3200800015 <== mon.0 v2:172.21.15.26:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbac4031e80 con 0x7fbad00cb5c0 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbab006c8f0 msgr2=0x7fbab006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbab006c8f0 0x7fbab006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbac0007fd0 tx=0x7fbac0009040 comp rx=0 tx=0).stop 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cb5c0 msgr2=0x7fbad00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cb5c0 0x7fbad00ccbc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbac40099c0 tx=0x7fbac40046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 shutdown_connections 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fbab006c8f0 0x7fbab006edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbad00cb9a0 0x7fbad00cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad00cb5c0 0x7fbad00ccbc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 --2- 172.21.15.26:0/3200800015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad00cae40 0x7fbad0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 >> 172.21.15.26:0/3200800015 conn(0x7fbad0074d50 msgr2=0x7fbad01528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:10.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.554+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 shutdown_connections 2024-04-25T13:18:10.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.555+0000 7fbad4930640 1 -- 172.21.15.26:0/3200800015 wait complete. 2024-04-25T13:18:10.565 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:18:10.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:18:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.666+0000 7f849b308640 1 Processor -- start 2024-04-25T13:18:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.667+0000 7f849b308640 1 -- start start 2024-04-25T13:18:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.667+0000 7f849b308640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f849406bb90 0x7f849415af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.667+0000 7f849b308640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849415bef0 con 0x7f84940c99f0 2024-04-25T13:18:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.667+0000 7f849b308640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849415b650 con 0x7f849406bf70 2024-04-25T13:18:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.667+0000 7f849b308640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f849415f510 con 0x7f849406bb90 2024-04-25T13:18:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f84990a4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f849406bb90 0x7f849415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f84998a5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f84940c99f0 0x7f8494154db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37034/0 (socket says 172.21.15.26:37034) 2024-04-25T13:18:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f84998a5640 1 -- 172.21.15.26:0/3308345776 learned_addr learned my addr 172.21.15.26:0/3308345776 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:18:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f848bfff640 1 -- 172.21.15.26:0/3308345776 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53587939 0 0) 0x7f849415bef0 con 0x7f84940c99f0 2024-04-25T13:18:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f848bfff640 1 -- 172.21.15.26:0/3308345776 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8480003520 con 0x7f84940c99f0 2024-04-25T13:18:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f84990a4640 1 -- 172.21.15.26:0/3308345776 >> v1:172.21.15.169:6789/0 conn(0x7f849406bf70 legacy=0x7f849415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f84990a4640 1 -- 172.21.15.26:0/3308345776 >> v1:172.21.15.26:6789/0 conn(0x7f84940c99f0 legacy=0x7f8494154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.668+0000 7f84990a4640 1 -- 172.21.15.26:0/3308345776 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849415b930 con 0x7f849406bb90 2024-04-25T13:18:10.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f84990a4640 1 --2- 172.21.15.26:0/3308345776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849406bb90 0x7f849415af70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f84900097a0 tx=0x7f849002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d3253d8f1afc35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:10.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f848bfff640 1 -- 172.21.15.26:0/3308345776 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490037070 con 0x7f849406bb90 2024-04-25T13:18:10.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f848bfff640 1 -- 172.21.15.26:0/3308345776 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8490032640 con 0x7f849406bb90 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f848bfff640 1 -- 172.21.15.26:0/3308345776 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490032a30 con 0x7f849406bb90 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f849b308640 1 -- 172.21.15.26:0/3308345776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849406bb90 msgr2=0x7f849415af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f849b308640 1 --2- 172.21.15.26:0/3308345776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849406bb90 0x7f849415af70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f84900097a0 tx=0x7f849002a2c0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f849b308640 1 -- 172.21.15.26:0/3308345776 shutdown_connections 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f849b308640 1 --2- 172.21.15.26:0/3308345776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849406bb90 0x7f849415af70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f849b308640 1 -- 172.21.15.26:0/3308345776 >> 172.21.15.26:0/3308345776 conn(0x7f8494074d50 msgr2=0x7f8494075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f849b308640 1 -- 172.21.15.26:0/3308345776 shutdown_connections 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.669+0000 7f849b308640 1 -- 172.21.15.26:0/3308345776 wait complete. 2024-04-25T13:18:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 Processor -- start 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 -- start start 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f849406bb90 0x7f8494159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f849406bf70 0x7f84941e4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84940c99f0 0x7f84941e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f849415e8e0 con 0x7f84940c99f0 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f849415e600 con 0x7f849406bf70 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f849b308640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8494074560 con 0x7f849406bb90 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f84998a5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84940c99f0 0x7f84941e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f84998a5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84940c99f0 0x7f84941e4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58694/0 (socket says 172.21.15.26:58694) 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.671+0000 7f84998a5640 1 -- 172.21.15.26:0/1445207956 learned_addr learned my addr 172.21.15.26:0/1445207956 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84988a3640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f849406bf70 0x7f84941e4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84990a4640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f849406bb90 0x7f8494159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84998a5640 1 -- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f849406bb90 msgr2=0x7f8494159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84998a5640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f849406bb90 0x7f8494159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84998a5640 1 -- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f849406bf70 msgr2=0x7f84941e4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84998a5640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f849406bf70 0x7f84941e4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84998a5640 1 -- 172.21.15.26:0/1445207956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8494145ad0 con 0x7f84940c99f0 2024-04-25T13:18:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84988a3640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f849406bf70 0x7f84941e4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f84998a5640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84940c99f0 0x7f84941e4e60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f848c00caa0 tx=0x7f848c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f8489ffb640 1 -- 172.21.15.26:0/1445207956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c017070 con 0x7f84940c99f0 2024-04-25T13:18:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f8489ffb640 1 -- 172.21.15.26:0/1445207956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f848c00ac00 con 0x7f84940c99f0 2024-04-25T13:18:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8494145d70 con 0x7f84940c99f0 2024-04-25T13:18:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f8489ffb640 1 -- 172.21.15.26:0/1445207956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c012400 con 0x7f84940c99f0 2024-04-25T13:18:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.672+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84941f1550 con 0x7f84940c99f0 2024-04-25T13:18:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.673+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8494068e40 con 0x7f84940c99f0 2024-04-25T13:18:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.674+0000 7f8489ffb640 1 -- 172.21.15.26:0/1445207956 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f848c01a070 con 0x7f84940c99f0 2024-04-25T13:18:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.674+0000 7f8489ffb640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f847806c8f0 0x7f847806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.674+0000 7f8489ffb640 1 -- 172.21.15.26:0/1445207956 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f848c08be30 con 0x7f84940c99f0 2024-04-25T13:18:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.674+0000 7f84990a4640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f847806c8f0 0x7f847806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.675+0000 7f84990a4640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f847806c8f0 0x7f847806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8490034000 tx=0x7f849002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.678+0000 7f8489ffb640 1 -- 172.21.15.26:0/1445207956 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f848c059d90 con 0x7f84940c99f0 2024-04-25T13:18:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.903+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84940ca3e0 con 0x7f84940c99f0 2024-04-25T13:18:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.904+0000 7f8489ffb640 1 -- 172.21.15.26:0/1445207956 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7f848c059690 con 0x7f84940c99f0 2024-04-25T13:18:10.904 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:18:10.904 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:17:03.388937+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4308,"mds_1":4305,"mds_2":4284,"mds_3":4279,"mds_4":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":4,"incarnation":18,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4250,4279,4305,4284,4308]},"id":1}]} 2024-04-25T13:18:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-25T13:18:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f847806c8f0 msgr2=0x7f847806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f847806c8f0 0x7f847806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8490034000 tx=0x7f849002e000 comp rx=0 tx=0).stop 2024-04-25T13:18:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84940c99f0 msgr2=0x7f84941e4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84940c99f0 0x7f84941e4e60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f848c00caa0 tx=0x7f848c00cf60 comp rx=0 tx=0).stop 2024-04-25T13:18:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 shutdown_connections 2024-04-25T13:18:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f847806c8f0 0x7f847806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84940c99f0 0x7f84941e4e60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f849406bf70 0x7f84941e4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 --2- 172.21.15.26:0/1445207956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f849406bb90 0x7f8494159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 >> 172.21.15.26:0/1445207956 conn(0x7f8494074d50 msgr2=0x7f8494154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 shutdown_connections 2024-04-25T13:18:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:10.906+0000 7f849b308640 1 -- 172.21.15.26:0/1445207956 wait complete. 2024-04-25T13:18:10.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:18:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.017+0000 7fa40dbcc640 1 Processor -- start 2024-04-25T13:18:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.017+0000 7fa40dbcc640 1 -- start start 2024-04-25T13:18:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.018+0000 7fa40dbcc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 0x7fa408071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.018+0000 7fa40dbcc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4080c7bd0 con 0x7fa408152fd0 2024-04-25T13:18:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.018+0000 7fa40dbcc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4080c86a0 con 0x7fa4080c6e00 2024-04-25T13:18:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.018+0000 7fa40dbcc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa4080c8980 con 0x7fa408074410 2024-04-25T13:18:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.018+0000 7fa4077fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa408152fd0 0x7fa408073730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37038/0 (socket says 172.21.15.26:37038) 2024-04-25T13:18:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.018+0000 7fa4077fe640 1 -- 172.21.15.26:0/2497101299 learned_addr learned my addr 172.21.15.26:0/2497101299 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:18:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa406ffd640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 0x7fa408071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823680802 0 0) 0x7fa4080c7bd0 con 0x7fa408152fd0 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f0003520 con 0x7fa408152fd0 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2629150942 0 0) 0x7fa3f0003520 con 0x7fa408152fd0 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 msgr2=0x7fa408071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 0x7fa408071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 >> v1:172.21.15.169:6789/0 conn(0x7fa4080c6e00 legacy=0x7fa4081636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40815c3d0 con 0x7fa408152fd0 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1556956567 0 0) 0x7fa3f8001670 con 0x7fa408152fd0 2024-04-25T13:18:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 >> v1:172.21.15.26:6789/0 conn(0x7fa408152fd0 legacy=0x7fa408073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 0x7fa3f00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0003f20 0x7fa3f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa3f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa4080c8980 con 0x7fa3f0004d40 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f000ba20 con 0x7fa3f0003f20 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f000bc20 con 0x7fa408074410 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa407fff640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa3f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa4077fe640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 0x7fa3f00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa406ffd640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0003f20 0x7fa3f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa407fff640 1 -- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 msgr2=0x7fa3f00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa407fff640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa408074410 0x7fa3f00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa407fff640 1 -- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0003f20 msgr2=0x7fa3f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa407fff640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0003f20 0x7fa3f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.019+0000 7fa407fff640 1 -- 172.21.15.26:0/2497101299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f0003520 con 0x7fa3f0004d40 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.020+0000 7fa407fff640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa3f00051c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa400001f60 tx=0x7fa3f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973f13e4ff6c55e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.020+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400001b30 con 0x7fa3f0004d40 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.020+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa400031620 con 0x7fa3f0004d40 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.020+0000 7fa4067fc640 1 -- 172.21.15.26:0/2497101299 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400031a30 con 0x7fa3f0004d40 2024-04-25T13:18:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.021+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2497101299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 msgr2=0x7fa3f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.021+0000 7fa40dbcc640 1 --2- 172.21.15.26:0/2497101299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa3f00051c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa400001f60 tx=0x7fa3f0005830 comp rx=0 tx=0).stop 2024-04-25T13:18:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.021+0000 7fa407fff640 1 -- 172.21.15.26:0/2497101299 reap_dead start 2024-04-25T13:18:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.021+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2497101299 shutdown_connections 2024-04-25T13:18:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.021+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2497101299 >> 172.21.15.26:0/2497101299 conn(0x7fa4080c8f00 msgr2=0x7fa4080c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.021+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2497101299 shutdown_connections 2024-04-25T13:18:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.021+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2497101299 wait complete. 2024-04-25T13:18:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.022+0000 7fa40dbcc640 1 Processor -- start 2024-04-25T13:18:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.022+0000 7fa40dbcc640 1 -- start start 2024-04-25T13:18:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa40dbcc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa408151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa40dbcc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40814e640 0x7fa4081ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa40dbcc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4081ef700 0x7fa40815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa40dbcc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa4080c8c60 con 0x7fa3f0004d40 2024-04-25T13:18:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa40dbcc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa40815c990 con 0x7fa4081ef700 2024-04-25T13:18:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa40dbcc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa4081533b0 con 0x7fa40814e640 2024-04-25T13:18:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa408151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa408151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58704/0 (socket says 172.21.15.26:58704) 2024-04-25T13:18:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 -- 172.21.15.26:0/2160489879 learned_addr learned my addr 172.21.15.26:0/2160489879 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa406ffd640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40814e640 0x7fa4081ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa407fff640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4081ef700 0x7fa40815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 -- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40814e640 msgr2=0x7fa4081ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40814e640 0x7fa4081ef1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 -- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4081ef700 msgr2=0x7fa40815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4081ef700 0x7fa40815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa4077fe640 1 -- 172.21.15.26:0/2160489879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4081f2d20 con 0x7fa3f0004d40 2024-04-25T13:18:11.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa406ffd640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40814e640 0x7fa4081ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:11.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.023+0000 7fa407fff640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4081ef700 0x7fa40815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.024+0000 7fa4077fe640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa408151ac0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80072f0 tx=0x7fa3f80077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.024+0000 7fa3effff640 1 -- 172.21.15.26:0/2160489879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800f8e0 con 0x7fa3f0004d40 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.024+0000 7fa3effff640 1 -- 172.21.15.26:0/2160489879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa3f8018070 con 0x7fa3f0004d40 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.024+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa408159760 con 0x7fa3f0004d40 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.024+0000 7fa3effff640 1 -- 172.21.15.26:0/2160489879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800fd20 con 0x7fa3f0004d40 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.024+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4081eecc0 con 0x7fa3f0004d40 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.025+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4080c86a0 con 0x7fa3f0004d40 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.025+0000 7fa3effff640 1 -- 172.21.15.26:0/2160489879 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3f801d460 con 0x7fa3f0004d40 2024-04-25T13:18:11.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.026+0000 7fa3effff640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa3f406c920 0x7fa3f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.026+0000 7fa3effff640 1 -- 172.21.15.26:0/2160489879 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fa3f808c150 con 0x7fa3f0004d40 2024-04-25T13:18:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.026+0000 7fa406ffd640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa3f406c920 0x7fa3f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.027+0000 7fa406ffd640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa3f406c920 0x7fa3f406ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa40815b3e0 tx=0x7fa3fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.030+0000 7fa3effff640 1 -- 172.21.15.26:0/2160489879 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4080c86a0 con 0x7fa3f0004d40 2024-04-25T13:18:11.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.252+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa408073230 con 0x7fa3f0004d40 2024-04-25T13:18:11.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.253+0000 7fa3effff640 1 -- 172.21.15.26:0/2160489879 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7fa408073230 con 0x7fa3f0004d40 2024-04-25T13:18:11.253 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:18:11.253 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3681151442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3681151442},{"type":"v1","addr":"172.21.15.26:6835","nonce":3681151442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:09.585455+0000","modified":"2024-04-25T13:17:03.388937+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4308,"mds_1":4305,"mds_2":4284,"mds_3":4279,"mds_4":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":4,"incarnation":18,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6838/2640767369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":2640767369},{"type":"v1","addr":"172.21.15.169:6838","nonce":2640767369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6837/189019616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":189019616},{"type":"v1","addr":"172.21.15.26:6837","nonce":189019616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6834/4286679763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4286679763},{"type":"v1","addr":"172.21.15.26:6834","nonce":4286679763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/1123161909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1123161909},{"type":"v1","addr":"172.21.15.169:6837","nonce":1123161909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.169:6839/963417679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":963417679},{"type":"v1","addr":"172.21.15.169:6839","nonce":963417679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4250,4279,4305,4284,4308]},"id":1}]} 2024-04-25T13:18:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-25T13:18:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa3f406c920 msgr2=0x7fa3f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa3f406c920 0x7fa3f406ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa40815b3e0 tx=0x7fa3fc008040 comp rx=0 tx=0).stop 2024-04-25T13:18:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 msgr2=0x7fa408151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa408151ac0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80072f0 tx=0x7fa3f80077b0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 shutdown_connections 2024-04-25T13:18:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7fa3f406c920 0x7fa3f406ede0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4081ef700 0x7fa40815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40814e640 0x7fa4081ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 --2- 172.21.15.26:0/2160489879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f0004d40 0x7fa408151ac0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.254+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 >> 172.21.15.26:0/2160489879 conn(0x7fa4080c8f00 msgr2=0x7fa4080c97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.255+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 shutdown_connections 2024-04-25T13:18:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.255+0000 7fa40dbcc640 1 -- 172.21.15.26:0/2160489879 wait complete. 2024-04-25T13:18:11.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:18:11.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.366+0000 7f987c4cf640 1 Processor -- start 2024-04-25T13:18:11.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.366+0000 7f987c4cf640 1 -- start start 2024-04-25T13:18:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987c4cf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f987415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987c4cf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98740b3c00 0x7f98740b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987c4cf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f98740b5450 0x7f98740d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987c4cf640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f98740b4a80 con 0x7f98740b3c00 2024-04-25T13:18:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987c4cf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f98741558c0 con 0x7f98740b5450 2024-04-25T13:18:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987c4cf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f987415f630 con 0x7f98741554e0 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98740b3c00 0x7f98740b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98740b3c00 0x7f98740b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58712/0 (socket says 172.21.15.26:58712) 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 -- 172.21.15.26:0/2982005674 learned_addr learned my addr 172.21.15.26:0/2982005674 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987aa6c640 1 --2- 172.21.15.26:0/2982005674 >> v2:172.21.15.169:3300/0 conn(0x7f98740b5450 0x7f98740d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987a26b640 1 --2- 172.21.15.26:0/2982005674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f987415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 -- 172.21.15.26:0/2982005674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 msgr2=0x7f987415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 --2- 172.21.15.26:0/2982005674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f987415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 -- 172.21.15.26:0/2982005674 >> v2:172.21.15.169:3300/0 conn(0x7f98740b5450 msgr2=0x7f98740d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 --2- 172.21.15.26:0/2982005674 >> v2:172.21.15.169:3300/0 conn(0x7f98740b5450 0x7f98740d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f9879a6a640 1 -- 172.21.15.26:0/2982005674 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98740cb8c0 con 0x7f98740b3c00 2024-04-25T13:18:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987aa6c640 1 --2- 172.21.15.26:0/2982005674 >> v2:172.21.15.169:3300/0 conn(0x7f98740b5450 0x7f98740d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.367+0000 7f987a26b640 1 --2- 172.21.15.26:0/2982005674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f987415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.368+0000 7f9879a6a640 1 --2- 172.21.15.26:0/2982005674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f98740b4f10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98740caf10 tx=0x7f986802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28924f5e98e8f9bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.368+0000 7f9879269640 1 -- 172.21.15.26:0/2982005674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868037070 con 0x7f98740b3c00 2024-04-25T13:18:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.368+0000 7f9879269640 1 -- 172.21.15.26:0/2982005674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9868032440 con 0x7f98740b3c00 2024-04-25T13:18:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.368+0000 7f9879269640 1 -- 172.21.15.26:0/2982005674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868032830 con 0x7f98740b3c00 2024-04-25T13:18:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 -- 172.21.15.26:0/2982005674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 msgr2=0x7f98740b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 --2- 172.21.15.26:0/2982005674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f98740b4f10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98740caf10 tx=0x7f986802a270 comp rx=0 tx=0).stop 2024-04-25T13:18:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 -- 172.21.15.26:0/2982005674 shutdown_connections 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 --2- 172.21.15.26:0/2982005674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f98740b4f10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 --2- 172.21.15.26:0/2982005674 >> v2:172.21.15.169:3300/0 conn(0x7f98740b5450 0x7f98740d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 --2- 172.21.15.26:0/2982005674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f987415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 -- 172.21.15.26:0/2982005674 >> 172.21.15.26:0/2982005674 conn(0x7f9874074d50 msgr2=0x7f9874075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 -- 172.21.15.26:0/2982005674 shutdown_connections 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.369+0000 7f987c4cf640 1 -- 172.21.15.26:0/2982005674 wait complete. 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.370+0000 7f987c4cf640 1 Processor -- start 2024-04-25T13:18:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.370+0000 7f987c4cf640 1 -- start start 2024-04-25T13:18:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f9874157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98740b5450 0x7f98740c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f98740c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f98740b4430 con 0x7f98740b3c00 2024-04-25T13:18:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98740b4150 con 0x7f98740b5450 2024-04-25T13:18:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f98740b4710 con 0x7f98741554e0 2024-04-25T13:18:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f9874157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f9874157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58716/0 (socket says 172.21.15.26:58716) 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 -- 172.21.15.26:0/97376884 learned_addr learned my addr 172.21.15.26:0/97376884 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987aa6c640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f98740c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 -- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 msgr2=0x7f98740c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f9879a6a640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98740b5450 0x7f98740c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f98740c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 -- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98740b5450 msgr2=0x7f98740c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98740b5450 0x7f98740c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 -- 172.21.15.26:0/97376884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98741f0c00 con 0x7f98740b3c00 2024-04-25T13:18:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f9879a6a640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98740b5450 0x7f98740c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987aa6c640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f98740c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987a26b640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f9874157ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c7f0 tx=0x7f986c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f9872ffd640 1 -- 172.21.15.26:0/97376884 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c015070 con 0x7f98740b3c00 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f9872ffd640 1 -- 172.21.15.26:0/97376884 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f986c007a30 con 0x7f98740b3c00 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987415f250 con 0x7f98740b3c00 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f9872ffd640 1 -- 172.21.15.26:0/97376884 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c007e20 con 0x7f98740b3c00 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.371+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987415e900 con 0x7f98740b3c00 2024-04-25T13:18:11.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.372+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987415eb40 con 0x7f98740b3c00 2024-04-25T13:18:11.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.373+0000 7f9872ffd640 1 -- 172.21.15.26:0/97376884 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f986c018070 con 0x7f98740b3c00 2024-04-25T13:18:11.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.373+0000 7f9872ffd640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f986006c920 0x7f986006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.373+0000 7f9872ffd640 1 -- 172.21.15.26:0/97376884 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f986c08c050 con 0x7f98740b3c00 2024-04-25T13:18:11.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.374+0000 7f9879a6a640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f986006c920 0x7f986006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.374+0000 7f9879a6a640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f986006c920 0x7f986006ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9868034000 tx=0x7f986802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.378+0000 7f9872ffd640 1 -- 172.21.15.26:0/97376884 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f987415eb40 con 0x7f98740b3c00 2024-04-25T13:18:11.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.563+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9874068e40 con 0x7f98740b3c00 2024-04-25T13:18:11.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.564+0000 7f9872ffd640 1 -- 172.21.15.26:0/97376884 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18947 (secure 0 0 0) 0x7f986c059fb0 con 0x7f98740b3c00 2024-04-25T13:18:11.564 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-25T13:18:11.565 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4a7b84-1cd1-4957-a762-8e7959ae0a88","created":"2024-04-25T13:15:44.980321+0000","modified":"2024-04-25T13:16:50.350764+0000","last_up_change":"2024-04-25T13:15:56.163882+0000","last_in_change":"2024-04-25T13:15:47.188399+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.175636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:07.306201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:08.537870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:12.230813+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"331ff599-600e-4525-a18c-1f77d3bbdc2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6817","nonce":2347346544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6819","nonce":2347346544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6823","nonce":2347346544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2347346544},{"type":"v1","addr":"172.21.15.26:6821","nonce":2347346544}]},"public_addr":"172.21.15.26:6817/2347346544","cluster_addr":"172.21.15.26:6819/2347346544","heartbeat_back_addr":"172.21.15.26:6823/2347346544","heartbeat_front_addr":"172.21.15.26:6821/2347346544","state":["exists","up"]},{"osd":1,"uuid":"ede2a9c7-4875-4495-b239-0f4c98a6e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6801","nonce":1755672510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6803","nonce":1755672510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6807","nonce":1755672510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":1755672510},{"type":"v1","addr":"172.21.15.26:6805","nonce":1755672510}]},"public_addr":"172.21.15.26:6801/1755672510","cluster_addr":"172.21.15.26:6803/1755672510","heartbeat_back_addr":"172.21.15.26:6807/1755672510","heartbeat_front_addr":"172.21.15.26:6805/1755672510","state":["exists","up"]},{"osd":2,"uuid":"a4427a0e-b66e-4b50-95da-715cdef3cbb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6809","nonce":1245488833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6811","nonce":1245488833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6815","nonce":1245488833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1245488833},{"type":"v1","addr":"172.21.15.26:6813","nonce":1245488833}]},"public_addr":"172.21.15.26:6809/1245488833","cluster_addr":"172.21.15.26:6811/1245488833","heartbeat_back_addr":"172.21.15.26:6815/1245488833","heartbeat_front_addr":"172.21.15.26:6813/1245488833","state":["exists","up"]},{"osd":3,"uuid":"173f6a99-2092-4c24-b834-e80e4b940259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6825","nonce":3590411791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6827","nonce":3590411791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6831","nonce":3590411791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3590411791},{"type":"v1","addr":"172.21.15.26:6829","nonce":3590411791}]},"public_addr":"172.21.15.26:6825/3590411791","cluster_addr":"172.21.15.26:6827/3590411791","heartbeat_back_addr":"172.21.15.26:6831/3590411791","heartbeat_front_addr":"172.21.15.26:6829/3590411791","state":["exists","up"]},{"osd":4,"uuid":"7bb418fc-87cf-4c4a-b5ff-e895195310bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6817","nonce":1358743323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6819","nonce":1358743323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6823","nonce":1358743323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1358743323},{"type":"v1","addr":"172.21.15.169:6821","nonce":1358743323}]},"public_addr":"172.21.15.169:6817/1358743323","cluster_addr":"172.21.15.169:6819/1358743323","heartbeat_back_addr":"172.21.15.169:6823/1358743323","heartbeat_front_addr":"172.21.15.169:6821/1358743323","state":["exists","up"]},{"osd":5,"uuid":"4ba42700-03b4-40d2-9edb-59b85f4b8527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6803","nonce":1715640241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6805","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6807","nonce":1715640241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6815","nonce":1715640241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1715640241},{"type":"v1","addr":"172.21.15.169:6811","nonce":1715640241}]},"public_addr":"172.21.15.169:6803/1715640241","cluster_addr":"172.21.15.169:6807/1715640241","heartbeat_back_addr":"172.21.15.169:6815/1715640241","heartbeat_front_addr":"172.21.15.169:6811/1715640241","state":["exists","up"]},{"osd":6,"uuid":"26397687-3ed9-407d-81db-eb9765059969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6825","nonce":3237270722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6827","nonce":3237270722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6831","nonce":3237270722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3237270722},{"type":"v1","addr":"172.21.15.169:6829","nonce":3237270722}]},"public_addr":"172.21.15.169:6825/3237270722","cluster_addr":"172.21.15.169:6827/3237270722","heartbeat_back_addr":"172.21.15.169:6831/3237270722","heartbeat_front_addr":"172.21.15.169:6829/3237270722","state":["exists","up"]},{"osd":7,"uuid":"872b5be9-f7e4-48ea-951d-fc41de585647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6801","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6802","nonce":3191394862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6806","nonce":3191394862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6814","nonce":3191394862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3191394862},{"type":"v1","addr":"172.21.15.169:6810","nonce":3191394862}]},"public_addr":"172.21.15.169:6802/3191394862","cluster_addr":"172.21.15.169:6806/3191394862","heartbeat_back_addr":"172.21.15.169:6814/3191394862","heartbeat_front_addr":"172.21.15.169:6810/3191394862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.304125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.334379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.381521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.382329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.323229+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.390808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:52.248030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:18:11.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f986006c920 msgr2=0x7f986006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f986006c920 0x7f986006ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9868034000 tx=0x7f986802e000 comp rx=0 tx=0).stop 2024-04-25T13:18:11.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 msgr2=0x7f9874157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f9874157ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c7f0 tx=0x7f986c00cbf0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 shutdown_connections 2024-04-25T13:18:11.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f986006c920 0x7f986006ede0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98741554e0 0x7f98740c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98740b5450 0x7f98740c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 --2- 172.21.15.26:0/97376884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98740b3c00 0x7f9874157ee0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 >> 172.21.15.26:0/97376884 conn(0x7f9874074d50 msgr2=0x7f9874075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:11.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 shutdown_connections 2024-04-25T13:18:11.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.566+0000 7f987c4cf640 1 -- 172.21.15.26:0/97376884 wait complete. 2024-04-25T13:18:11.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T13:18:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.680+0000 7f4773c59640 1 Processor -- start 2024-04-25T13:18:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.680+0000 7f4773c59640 1 -- start start 2024-04-25T13:18:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f4773c59640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f476c155550 0x7f476c15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f4773c59640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f476c0ccf00 con 0x7f476c0cb9e0 2024-04-25T13:18:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f4773c59640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f476c0cd1e0 con 0x7f476c155170 2024-04-25T13:18:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f4773c59640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f476c0cddf0 con 0x7f476c155550 2024-04-25T13:18:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f47711f4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f476c155550 0x7f476c15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f47721f6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f476c0cb9e0 0x7f476c0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37046/0 (socket says 172.21.15.26:37046) 2024-04-25T13:18:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f47721f6640 1 -- 172.21.15.26:0/850615035 learned_addr learned my addr 172.21.15.26:0/850615035 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:18:11.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f47711f4640 1 -- 172.21.15.26:0/850615035 >> v1:172.21.15.169:6789/0 conn(0x7f476c155170 legacy=0x7f476c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:11.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f47711f4640 1 -- 172.21.15.26:0/850615035 >> v1:172.21.15.26:6789/0 conn(0x7f476c0cb9e0 legacy=0x7f476c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f47711f4640 1 -- 172.21.15.26:0/850615035 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c0cd4c0 con 0x7f476c155550 2024-04-25T13:18:11.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.681+0000 7f47709f3640 1 -- 172.21.15.26:0/850615035 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243723225 0 0) 0x7f476c0ccf00 con 0x7f476c0cb9e0 2024-04-25T13:18:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.682+0000 7f47711f4640 1 --2- 172.21.15.26:0/850615035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c155550 0x7f476c15eef0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f476c0cdf70 tx=0x7f475c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a109c2968ca29d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.682+0000 7f47709f3640 1 -- 172.21.15.26:0/850615035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c037070 con 0x7f476c155550 2024-04-25T13:18:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.682+0000 7f47709f3640 1 -- 172.21.15.26:0/850615035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f475c032440 con 0x7f476c155550 2024-04-25T13:18:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.682+0000 7f47709f3640 1 -- 172.21.15.26:0/850615035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c032830 con 0x7f476c155550 2024-04-25T13:18:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.683+0000 7f4773c59640 1 -- 172.21.15.26:0/850615035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c155550 msgr2=0x7f476c15eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.683+0000 7f4773c59640 1 --2- 172.21.15.26:0/850615035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c155550 0x7f476c15eef0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f476c0cdf70 tx=0x7f475c02a200 comp rx=0 tx=0).stop 2024-04-25T13:18:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.683+0000 7f4773c59640 1 -- 172.21.15.26:0/850615035 shutdown_connections 2024-04-25T13:18:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.683+0000 7f4773c59640 1 --2- 172.21.15.26:0/850615035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c155550 0x7f476c15eef0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.683+0000 7f4773c59640 1 -- 172.21.15.26:0/850615035 >> 172.21.15.26:0/850615035 conn(0x7f476c072570 msgr2=0x7f476c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.683+0000 7f4773c59640 1 -- 172.21.15.26:0/850615035 shutdown_connections 2024-04-25T13:18:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.683+0000 7f4773c59640 1 -- 172.21.15.26:0/850615035 wait complete. 2024-04-25T13:18:11.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.684+0000 7f4773c59640 1 Processor -- start 2024-04-25T13:18:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.684+0000 7f4773c59640 1 -- start start 2024-04-25T13:18:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c0cb9e0 0x7f476c158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f476c155170 0x7f476c15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f476c155550 0x7f476c15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f476c0cda80 con 0x7f476c0cb9e0 2024-04-25T13:18:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f476c15f430 con 0x7f476c155550 2024-04-25T13:18:11.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f476c0ccae0 con 0x7f476c155170 2024-04-25T13:18:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c0cb9e0 0x7f476c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c0cb9e0 0x7f476c158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58734/0 (socket says 172.21.15.26:58734) 2024-04-25T13:18:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 -- 172.21.15.26:0/2306190905 learned_addr learned my addr 172.21.15.26:0/2306190905 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:11.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47721f6640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f476c155550 0x7f476c15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 -- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f476c155170 msgr2=0x7f476c15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f476c155170 0x7f476c15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 -- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f476c155550 msgr2=0x7f476c15c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f476c155550 0x7f476c15c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 -- 172.21.15.26:0/2306190905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c157380 con 0x7f476c0cb9e0 2024-04-25T13:18:11.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47719f5640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c0cb9e0 0x7f476c158070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f476800c460 tx=0x7f476800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47627fc640 1 -- 172.21.15.26:0/2306190905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768016020 con 0x7f476c0cb9e0 2024-04-25T13:18:11.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47627fc640 1 -- 172.21.15.26:0/2306190905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4768012870 con 0x7f476c0cb9e0 2024-04-25T13:18:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c15aed0 con 0x7f476c0cb9e0 2024-04-25T13:18:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f47627fc640 1 -- 172.21.15.26:0/2306190905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768012c80 con 0x7f476c0cb9e0 2024-04-25T13:18:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.685+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c15b490 con 0x7f476c0cb9e0 2024-04-25T13:18:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.686+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c068e40 con 0x7f476c0cb9e0 2024-04-25T13:18:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.687+0000 7f47627fc640 1 -- 172.21.15.26:0/2306190905 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4768019020 con 0x7f476c0cb9e0 2024-04-25T13:18:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.687+0000 7f47627fc640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f475006c920 0x7f475006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.687+0000 7f47627fc640 1 -- 172.21.15.26:0/2306190905 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f476808bda0 con 0x7f476c0cb9e0 2024-04-25T13:18:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.687+0000 7f47711f4640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f475006c920 0x7f475006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.688+0000 7f47711f4640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f475006c920 0x7f475006ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f475c034000 tx=0x7f475c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:11.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.691+0000 7f47627fc640 1 -- 172.21.15.26:0/2306190905 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4768020030 con 0x7f476c0cb9e0 2024-04-25T13:18:11.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.916+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f476c0cc2b0 con 0x7f476c0cb9e0 2024-04-25T13:18:11.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.918+0000 7f47627fc640 1 -- 172.21.15.26:0/2306190905 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f4768012e20 con 0x7f476c0cb9e0 2024-04-25T13:18:11.918 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T13:18:11.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f475006c920 msgr2=0x7f475006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f475006c920 0x7f475006ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f475c034000 tx=0x7f475c02c000 comp rx=0 tx=0).stop 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c0cb9e0 msgr2=0x7f476c158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c0cb9e0 0x7f476c158070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f476800c460 tx=0x7f476800c920 comp rx=0 tx=0).stop 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 shutdown_connections 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f475006c920 0x7f475006ede0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f476c155550 0x7f476c15c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f476c155170 0x7f476c15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 --2- 172.21.15.26:0/2306190905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f476c0cb9e0 0x7f476c158070 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:11.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 >> 172.21.15.26:0/2306190905 conn(0x7f476c072570 msgr2=0x7f476c1e4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:11.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 shutdown_connections 2024-04-25T13:18:11.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:11.921+0000 7f4773c59640 1 -- 172.21.15.26:0/2306190905 wait complete. 2024-04-25T13:18:11.927 INFO:tasks.ceph.mds.f.smithi169.stderr: -4836> 2024-04-25T13:16:28.744+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:18:11.928 INFO:tasks.ceph.mds.f.smithi169.stderr: -4005> 2024-04-25T13:16:48.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T13:18:11.928 INFO:tasks.ceph.mds.f.smithi169.stderr: -3703> 2024-04-25T13:16:53.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T13:18:11.928 INFO:tasks.ceph.mds.f.smithi169.stderr: -3375> 2024-04-25T13:16:58.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-25T13:18:11.929 INFO:tasks.ceph.mds.f.smithi169.stderr: -3060> 2024-04-25T13:17:03.746+0000 7fb17fce4640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-25T13:18:11.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T13:18:11.951 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2024-04-25T13:18:11.953 INFO:tasks.ceph.mds.e.smithi026.stdout:starting mds.e at 2024-04-25T13:18:11.958 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-04-25T13:18:11.958 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-04-25T13:18:11.958 INFO:tasks.ceph.mds.f.smithi169.stdout:starting mds.f at 2024-04-25T13:18:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.041+0000 7f224d3bf640 1 Processor -- start 2024-04-25T13:18:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.041+0000 7f224d3bf640 1 -- start start 2024-04-25T13:18:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f224d3bf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2248152f20 0x7f22480cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f224d3bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22480ca3b0 0x7f22480cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f224d3bf640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22480c7b20 con 0x7f2248153300 2024-04-25T13:18:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f224d3bf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f22480c9810 con 0x7f2248152f20 2024-04-25T13:18:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f224d3bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f22480cac60 con 0x7f22480ca3b0 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f22467fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2248153300 0x7f22480c9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37052/0 (socket says 172.21.15.26:37052) 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f22467fc640 1 -- 172.21.15.26:0/3408539602 learned_addr learned my addr 172.21.15.26:0/3408539602 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f2246ffd640 1 --2- 172.21.15.26:0/3408539602 >> v2:172.21.15.169:3300/0 conn(0x7f2248152f20 0x7f22480cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.042+0000 7f22477fe640 1 --2- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22480ca3b0 0x7f22480cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.043+0000 7f2245ffb640 1 -- 172.21.15.26:0/3408539602 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092987765 0 0) 0x7f22480c7b20 con 0x7f2248153300 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.043+0000 7f2245ffb640 1 -- 172.21.15.26:0/3408539602 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2230003520 con 0x7f2248153300 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.043+0000 7f2246ffd640 1 -- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22480ca3b0 msgr2=0x7f22480cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.043+0000 7f2246ffd640 1 --2- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22480ca3b0 0x7f22480cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.043+0000 7f2246ffd640 1 -- 172.21.15.26:0/3408539602 >> v1:172.21.15.26:6789/0 conn(0x7f2248153300 legacy=0x7f22480c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.043+0000 7f2246ffd640 1 -- 172.21.15.26:0/3408539602 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22480c7d90 con 0x7f2248152f20 2024-04-25T13:18:12.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f2246ffd640 1 --2- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f22480cb3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22400097a0 tx=0x7f224002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f488819c89d5951 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:12.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f2245ffb640 1 -- 172.21.15.26:0/3408539602 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240037070 con 0x7f2248152f20 2024-04-25T13:18:12.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f2245ffb640 1 -- 172.21.15.26:0/3408539602 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2240032440 con 0x7f2248152f20 2024-04-25T13:18:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f2245ffb640 1 -- 172.21.15.26:0/3408539602 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240032830 con 0x7f2248152f20 2024-04-25T13:18:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 -- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 msgr2=0x7f22480cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 --2- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f22480cb3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22400097a0 tx=0x7f224002a210 comp rx=0 tx=0).stop 2024-04-25T13:18:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 -- 172.21.15.26:0/3408539602 shutdown_connections 2024-04-25T13:18:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 --2- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22480ca3b0 0x7f22480cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 --2- 172.21.15.26:0/3408539602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f22480cb3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 -- 172.21.15.26:0/3408539602 >> 172.21.15.26:0/3408539602 conn(0x7f2248074f30 msgr2=0x7f2248075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 -- 172.21.15.26:0/3408539602 shutdown_connections 2024-04-25T13:18:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.044+0000 7f224d3bf640 1 -- 172.21.15.26:0/3408539602 wait complete. 2024-04-25T13:18:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 Processor -- start 2024-04-25T13:18:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 -- start start 2024-04-25T13:18:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22480ca3b0 0x7f2248144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f2248150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2248153300 0x7f22481452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f22480c8630 con 0x7f22480ca3b0 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f22480c8350 con 0x7f2248152f20 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f224d3bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f22480c8910 con 0x7f2248153300 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f2246ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22480ca3b0 0x7f2248144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f2246ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22480ca3b0 0x7f2248144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58786/0 (socket says 172.21.15.26:58786) 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.046+0000 7f2246ffd640 1 -- 172.21.15.26:0/2445764297 learned_addr learned my addr 172.21.15.26:0/2445764297 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f22477fe640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2248153300 0x7f22481452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f22467fc640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f2248150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f2246ffd640 1 -- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2248153300 msgr2=0x7f22481452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f2246ffd640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2248153300 0x7f22481452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f2246ffd640 1 -- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 msgr2=0x7f2248150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f2246ffd640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f2248150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f2246ffd640 1 -- 172.21.15.26:0/2445764297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2248153840 con 0x7f22480ca3b0 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f22477fe640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2248153300 0x7f22481452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f22467fc640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f2248150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f2246ffd640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22480ca3b0 0x7f2248144c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2240035040 tx=0x7f22400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f222f7fe640 1 -- 172.21.15.26:0/2445764297 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240041030 con 0x7f22480ca3b0 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f222f7fe640 1 -- 172.21.15.26:0/2445764297 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22400304c0 con 0x7f22480ca3b0 2024-04-25T13:18:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f222f7fe640 1 -- 172.21.15.26:0/2445764297 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240037040 con 0x7f22480ca3b0 2024-04-25T13:18:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2248153b20 con 0x7f22480ca3b0 2024-04-25T13:18:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.047+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22481540e0 con 0x7f22480ca3b0 2024-04-25T13:18:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.048+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2248069520 con 0x7f22480ca3b0 2024-04-25T13:18:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.049+0000 7f222f7fe640 1 -- 172.21.15.26:0/2445764297 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22400308d0 con 0x7f22480ca3b0 2024-04-25T13:18:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.049+0000 7f222f7fe640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f223406c8f0 0x7f223406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.049+0000 7f222f7fe640 1 -- 172.21.15.26:0/2445764297 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7223+0+0 (secure 0 0 0) 0x7f22400ac5f0 con 0x7f22480ca3b0 2024-04-25T13:18:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.049+0000 7f22467fc640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f223406c8f0 0x7f223406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.050+0000 7f22467fc640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f223406c8f0 0x7f223406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2248150bc0 tx=0x7f223c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.053+0000 7f222f7fe640 1 -- 172.21.15.26:0/2445764297 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2248069520 con 0x7f22480ca3b0 2024-04-25T13:18:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.278+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2248068f50 con 0x7f22480ca3b0 2024-04-25T13:18:12.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.919+0000 7f222f7fe640 1 -- 172.21.15.26:0/2445764297 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f224004b020 con 0x7f22480ca3b0 2024-04-25T13:18:12.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f223406c8f0 msgr2=0x7f223406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:12.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f223406c8f0 0x7f223406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2248150bc0 tx=0x7f223c009040 comp rx=0 tx=0).stop 2024-04-25T13:18:12.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22480ca3b0 msgr2=0x7f2248144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:12.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22480ca3b0 0x7f2248144c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2240035040 tx=0x7f22400046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 shutdown_connections 2024-04-25T13:18:12.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f223406c8f0 0x7f223406edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2248153300 0x7f22481452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2248152f20 0x7f2248150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 --2- 172.21.15.26:0/2445764297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22480ca3b0 0x7f2248144c40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 >> 172.21.15.26:0/2445764297 conn(0x7f2248074f30 msgr2=0x7f2248149040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 shutdown_connections 2024-04-25T13:18:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:12.922+0000 7f224d3bf640 1 -- 172.21.15.26:0/2445764297 wait complete. 2024-04-25T13:18:12.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T13:18:13.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.089+0000 7f8a5f3e5640 1 Processor -- start 2024-04-25T13:18:13.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.089+0000 7f8a5f3e5640 1 -- start start 2024-04-25T13:18:13.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5f3e5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a58155350 0x7f8a5815af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5f3e5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a580cb3c0 con 0x7f8a580c5b80 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5f3e5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5815e660 con 0x7f8a580cdff0 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5f3e5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a58155730 con 0x7f8a58155350 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5d982640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8a580c5b80 0x7f8a580c6010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37056/0 (socket says 172.21.15.26:37056) 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5d982640 1 -- 172.21.15.26:0/2947784944 learned_addr learned my addr 172.21.15.26:0/2947784944 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5d181640 1 --2- 172.21.15.26:0/2947784944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a58155350 0x7f8a5815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a4ffff640 1 -- 172.21.15.26:0/2947784944 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440361402 0 0) 0x7f8a580cb3c0 con 0x7f8a580c5b80 2024-04-25T13:18:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a4ffff640 1 -- 172.21.15.26:0/2947784944 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a44003520 con 0x7f8a580c5b80 2024-04-25T13:18:13.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a4ffff640 1 -- 172.21.15.26:0/2947784944 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106581653 0 0) 0x7f8a5815e660 con 0x7f8a580cdff0 2024-04-25T13:18:13.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a4ffff640 1 -- 172.21.15.26:0/2947784944 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a580cb3c0 con 0x7f8a580cdff0 2024-04-25T13:18:13.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5d181640 1 -- 172.21.15.26:0/2947784944 >> v1:172.21.15.169:6789/0 conn(0x7f8a580cdff0 legacy=0x7f8a58073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:13.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5d181640 1 -- 172.21.15.26:0/2947784944 >> v1:172.21.15.26:6789/0 conn(0x7f8a580c5b80 legacy=0x7f8a580c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:13.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.090+0000 7f8a5d181640 1 -- 172.21.15.26:0/2947784944 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5815e940 con 0x7f8a58155350 2024-04-25T13:18:13.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.091+0000 7f8a5d181640 1 --2- 172.21.15.26:0/2947784944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a58155350 0x7f8a5815af80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097d0 tx=0x7f8a5402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8fd016eb0e1a627 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:13.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.091+0000 7f8a4ffff640 1 -- 172.21.15.26:0/2947784944 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037070 con 0x7f8a58155350 2024-04-25T13:18:13.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.091+0000 7f8a4ffff640 1 -- 172.21.15.26:0/2947784944 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a54032440 con 0x7f8a58155350 2024-04-25T13:18:13.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.091+0000 7f8a4ffff640 1 -- 172.21.15.26:0/2947784944 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540327f0 con 0x7f8a58155350 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.092+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/2947784944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a58155350 msgr2=0x7f8a5815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.092+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/2947784944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a58155350 0x7f8a5815af80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097d0 tx=0x7f8a5402a210 comp rx=0 tx=0).stop 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.092+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/2947784944 shutdown_connections 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.092+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/2947784944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a58155350 0x7f8a5815af80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.092+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/2947784944 >> 172.21.15.26:0/2947784944 conn(0x7f8a580685a0 msgr2=0x7f8a58071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.092+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/2947784944 shutdown_connections 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.092+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/2947784944 wait complete. 2024-04-25T13:18:13.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.093+0000 7f8a5f3e5640 1 Processor -- start 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.093+0000 7f8a5f3e5640 1 -- start start 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5f3e5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a580c5b80 0x7f8a581e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5f3e5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a580cdff0 0x7f8a581e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5f3e5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155350 0x7f8a580c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5f3e5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5815f1e0 con 0x7f8a58155350 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5f3e5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5815ef00 con 0x7f8a580c5b80 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5f3e5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a58073880 con 0x7f8a580cdff0 2024-04-25T13:18:13.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155350 0x7f8a580c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155350 0x7f8a580c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58788/0 (socket says 172.21.15.26:58788) 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 -- 172.21.15.26:0/1753924536 learned_addr learned my addr 172.21.15.26:0/1753924536 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d181640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a580c5b80 0x7f8a581e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5c980640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a580cdff0 0x7f8a581e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 -- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a580cdff0 msgr2=0x7f8a581e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a580cdff0 0x7f8a581e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 -- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a580c5b80 msgr2=0x7f8a581e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:13.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a580c5b80 0x7f8a581e5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:13.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 -- 172.21.15.26:0/1753924536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a581e4600 con 0x7f8a58155350 2024-04-25T13:18:13.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.094+0000 7f8a5d982640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155350 0x7f8a580c7ba0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000caf0 tx=0x7f8a5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:13.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.095+0000 7f8a4dffb640 1 -- 172.21.15.26:0/1753924536 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50017070 con 0x7f8a58155350 2024-04-25T13:18:13.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.095+0000 7f8a4dffb640 1 -- 172.21.15.26:0/1753924536 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a5000aca0 con 0x7f8a58155350 2024-04-25T13:18:13.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.095+0000 7f8a4dffb640 1 -- 172.21.15.26:0/1753924536 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50012640 con 0x7f8a58155350 2024-04-25T13:18:13.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.095+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a581e48a0 con 0x7f8a58155350 2024-04-25T13:18:13.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.095+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a58149070 con 0x7f8a58155350 2024-04-25T13:18:13.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.096+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a580cad50 con 0x7f8a58155350 2024-04-25T13:18:13.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.096+0000 7f8a4dffb640 1 -- 172.21.15.26:0/1753924536 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a5001a070 con 0x7f8a58155350 2024-04-25T13:18:13.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.097+0000 7f8a4dffb640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a3c06c8f0 0x7f8a3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:13.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.097+0000 7f8a4dffb640 1 -- 172.21.15.26:0/1753924536 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7223+0+0 (secure 0 0 0) 0x7f8a5008be50 con 0x7f8a58155350 2024-04-25T13:18:13.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.097+0000 7f8a5d181640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a3c06c8f0 0x7f8a3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:13.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.097+0000 7f8a5d181640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a3c06c8f0 0x7f8a3c06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8a54034000 tx=0x7f8a5402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:13.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.101+0000 7f8a4dffb640 1 -- 172.21.15.26:0/1753924536 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a50059640 con 0x7f8a58155350 2024-04-25T13:18:13.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.291+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8a580d03a0 con 0x7f8a58155350 2024-04-25T13:18:13.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.924+0000 7f8a4dffb640 1 -- 172.21.15.26:0/1753924536 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f8a5008b020 con 0x7f8a58155350 2024-04-25T13:18:13.924 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2024-04-25T13:18:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.927+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a3c06c8f0 msgr2=0x7f8a3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.927+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a3c06c8f0 0x7f8a3c06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8a54034000 tx=0x7f8a5402e000 comp rx=0 tx=0).stop 2024-04-25T13:18:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.927+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155350 msgr2=0x7f8a580c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.927+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155350 0x7f8a580c7ba0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000caf0 tx=0x7f8a5000a060 comp rx=0 tx=0).stop 2024-04-25T13:18:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 shutdown_connections 2024-04-25T13:18:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f8a3c06c8f0 0x7f8a3c06edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155350 0x7f8a580c7ba0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a580cdff0 0x7f8a581e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 --2- 172.21.15.26:0/1753924536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a580c5b80 0x7f8a581e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 >> 172.21.15.26:0/1753924536 conn(0x7f8a580685a0 msgr2=0x7f8a5814b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 shutdown_connections 2024-04-25T13:18:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:13.928+0000 7f8a5f3e5640 1 -- 172.21.15.26:0/1753924536 wait complete. 2024-04-25T13:18:13.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T13:18:14.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.053+0000 7f297ec72640 1 Processor -- start 2024-04-25T13:18:14.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.053+0000 7f297ec72640 1 -- start start 2024-04-25T13:18:14.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297ec72640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f29780c38a0 0x7f2978073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297ec72640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29780c7340 0x7f2978073db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297ec72640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29780c60f0 con 0x7f2978153170 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297ec72640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f29780c7b80 con 0x7f29780c7340 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297ec72640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f29780c69e0 con 0x7f29780c38a0 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297ca0e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2978153170 0x7f2978158ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40472/0 (socket says 172.21.15.26:40472) 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297ca0e640 1 -- 172.21.15.26:0/3619132283 learned_addr learned my addr 172.21.15.26:0/3619132283 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f297d20f640 1 --2- 172.21.15.26:0/3619132283 >> v2:172.21.15.26:3300/0 conn(0x7f29780c7340 0x7f2978073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f2977fff640 1 --2- 172.21.15.26:0/3619132283 >> v2:172.21.15.169:3300/0 conn(0x7f29780c38a0 0x7f2978073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:14.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.054+0000 7f29777fe640 1 -- 172.21.15.26:0/3619132283 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899678603 0 0) 0x7f29780c60f0 con 0x7f2978153170 2024-04-25T13:18:14.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f29777fe640 1 -- 172.21.15.26:0/3619132283 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2960003520 con 0x7f2978153170 2024-04-25T13:18:14.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f297d20f640 1 -- 172.21.15.26:0/3619132283 >> v2:172.21.15.169:3300/0 conn(0x7f29780c38a0 msgr2=0x7f2978073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:14.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f297d20f640 1 --2- 172.21.15.26:0/3619132283 >> v2:172.21.15.169:3300/0 conn(0x7f29780c38a0 0x7f2978073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f297d20f640 1 -- 172.21.15.26:0/3619132283 >> v1:172.21.15.26:6789/0 conn(0x7f2978153170 legacy=0x7f2978158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:14.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f297d20f640 1 -- 172.21.15.26:0/3619132283 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29780c78a0 con 0x7f29780c7340 2024-04-25T13:18:14.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f297d20f640 1 --2- 172.21.15.26:0/3619132283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f2978073db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f297806e3a0 tx=0x7f296802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac6be8df0f61c2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f29777fe640 1 -- 172.21.15.26:0/3619132283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968037070 con 0x7f29780c7340 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f29777fe640 1 -- 172.21.15.26:0/3619132283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2968032440 con 0x7f29780c7340 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.055+0000 7f29777fe640 1 -- 172.21.15.26:0/3619132283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968032830 con 0x7f29780c7340 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 -- 172.21.15.26:0/3619132283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 msgr2=0x7f2978073db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 --2- 172.21.15.26:0/3619132283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f2978073db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f297806e3a0 tx=0x7f296802a230 comp rx=0 tx=0).stop 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 -- 172.21.15.26:0/3619132283 shutdown_connections 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 --2- 172.21.15.26:0/3619132283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f2978073db0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 --2- 172.21.15.26:0/3619132283 >> v2:172.21.15.169:3300/0 conn(0x7f29780c38a0 0x7f2978073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 -- 172.21.15.26:0/3619132283 >> 172.21.15.26:0/3619132283 conn(0x7f297806f220 msgr2=0x7f297806f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:14.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 -- 172.21.15.26:0/3619132283 shutdown_connections 2024-04-25T13:18:14.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.056+0000 7f297ec72640 1 -- 172.21.15.26:0/3619132283 wait complete. 2024-04-25T13:18:14.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.057+0000 7f297ec72640 1 Processor -- start 2024-04-25T13:18:14.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.057+0000 7f297ec72640 1 -- start start 2024-04-25T13:18:14.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297ec72640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29780c38a0 0x7f2978155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:14.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297ec72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f297814d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:14.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297ec72640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2978153170 0x7f297814a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:14.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297ec72640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29780c6670 con 0x7f29780c7340 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297ec72640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29780c6e70 con 0x7f29780c38a0 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297ec72640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2978153550 con 0x7f2978153170 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f2977fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f297814d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f2977fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f297814d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45176/0 (socket says 172.21.15.26:45176) 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f2977fff640 1 -- 172.21.15.26:0/1543678260 learned_addr learned my addr 172.21.15.26:0/1543678260 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297ca0e640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29780c38a0 0x7f2978155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f2977fff640 1 -- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2978153170 msgr2=0x7f297814a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:14.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f297d20f640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2978153170 0x7f297814a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f2977fff640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2978153170 0x7f297814a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f2977fff640 1 -- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29780c38a0 msgr2=0x7f2978155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.058+0000 7f2977fff640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29780c38a0 0x7f2978155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.059+0000 7f2977fff640 1 -- 172.21.15.26:0/1543678260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2978149700 con 0x7f29780c7340 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.059+0000 7f2977fff640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f297814d680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f296c00e980 tx=0x7f296c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.059+0000 7f29757fa640 1 -- 172.21.15.26:0/1543678260 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c017070 con 0x7f29780c7340 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.059+0000 7f29757fa640 1 -- 172.21.15.26:0/1543678260 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f296c00ca00 con 0x7f29780c7340 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.059+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29781499e0 con 0x7f29780c7340 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.059+0000 7f29757fa640 1 -- 172.21.15.26:0/1543678260 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c00cdf0 con 0x7f29780c7340 2024-04-25T13:18:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.059+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2978149fa0 con 0x7f29780c7340 2024-04-25T13:18:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.060+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297806e060 con 0x7f29780c7340 2024-04-25T13:18:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.060+0000 7f29757fa640 1 -- 172.21.15.26:0/1543678260 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f296c01a070 con 0x7f29780c7340 2024-04-25T13:18:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.061+0000 7f29757fa640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f296406c920 0x7f296406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.061+0000 7f29757fa640 1 -- 172.21.15.26:0/1543678260 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6785+0+0 (secure 0 0 0) 0x7f296c08bfe0 con 0x7f29780c7340 2024-04-25T13:18:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.061+0000 7f297ca0e640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f296406c920 0x7f296406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.062+0000 7f297ca0e640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f296406c920 0x7f296406ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f29700012e0 tx=0x7f2970009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.065+0000 7f29757fa640 1 -- 172.21.15.26:0/1543678260 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f296c059f40 con 0x7f29780c7340 2024-04-25T13:18:14.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.248+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f297814c5e0 con 0x7f29780c7340 2024-04-25T13:18:14.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.926+0000 7f29757fa640 1 -- 172.21.15.26:0/1543678260 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f296c059840 con 0x7f29780c7340 2024-04-25T13:18:14.926 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2024-04-25T13:18:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f296406c920 msgr2=0x7f296406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f296406c920 0x7f296406ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f29700012e0 tx=0x7f2970009040 comp rx=0 tx=0).stop 2024-04-25T13:18:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 msgr2=0x7f297814d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f297814d680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f296c00e980 tx=0x7f296c00ee40 comp rx=0 tx=0).stop 2024-04-25T13:18:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 shutdown_connections 2024-04-25T13:18:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f296406c920 0x7f296406ede0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2978153170 0x7f297814a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780c7340 0x7f297814d680 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 --2- 172.21.15.26:0/1543678260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29780c38a0 0x7f2978155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 >> 172.21.15.26:0/1543678260 conn(0x7f297806f220 msgr2=0x7f2978151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 shutdown_connections 2024-04-25T13:18:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:14.930+0000 7f297ec72640 1 -- 172.21.15.26:0/1543678260 wait complete. 2024-04-25T13:18:14.945 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T13:18:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.056+0000 7f45c515d640 1 Processor -- start 2024-04-25T13:18:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.057+0000 7f45c515d640 1 -- start start 2024-04-25T13:18:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.057+0000 7f45c515d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45c015f2a0 0x7f45c006bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.057+0000 7f45c515d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f45c00c9270 0x7f45c006c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.057+0000 7f45c515d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c015b3d0 con 0x7f45c006b920 2024-04-25T13:18:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.057+0000 7f45c515d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f45c006c780 con 0x7f45c015f2a0 2024-04-25T13:18:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.057+0000 7f45c515d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f45c015c230 con 0x7f45c00c9270 2024-04-25T13:18:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.057+0000 7f45be59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45c015f2a0 0x7f45c006bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.058+0000 7f45be59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45c015f2a0 0x7f45c006bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45180/0 (socket says 172.21.15.26:45180) 2024-04-25T13:18:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.058+0000 7f45be59c640 1 -- 172.21.15.26:0/3728922953 learned_addr learned my addr 172.21.15.26:0/3728922953 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.058+0000 7f45bf59e640 1 --2- 172.21.15.26:0/3728922953 >> v2:172.21.15.169:3300/0 conn(0x7f45c00c9270 0x7f45c006c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.058+0000 7f45be59c640 1 -- 172.21.15.26:0/3728922953 >> v2:172.21.15.169:3300/0 conn(0x7f45c00c9270 msgr2=0x7f45c006c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.058+0000 7f45be59c640 1 --2- 172.21.15.26:0/3728922953 >> v2:172.21.15.169:3300/0 conn(0x7f45c00c9270 0x7f45c006c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.058+0000 7f45be59c640 1 -- 172.21.15.26:0/3728922953 >> v1:172.21.15.169:6789/0 conn(0x7f45c006b920 legacy=0x7f45c015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.058+0000 7f45be59c640 1 -- 172.21.15.26:0/3728922953 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c015b6b0 con 0x7f45c015f2a0 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45be59c640 1 --2- 172.21.15.26:0/3728922953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c015f2a0 0x7f45c006bd00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f45c0073360 tx=0x7f45b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9028de141576cd32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45bdd9b640 1 -- 172.21.15.26:0/3728922953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4037070 con 0x7f45c015f2a0 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45bdd9b640 1 -- 172.21.15.26:0/3728922953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45b4032440 con 0x7f45c015f2a0 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45bdd9b640 1 -- 172.21.15.26:0/3728922953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4032830 con 0x7f45c015f2a0 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 -- 172.21.15.26:0/3728922953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c015f2a0 msgr2=0x7f45c006bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 --2- 172.21.15.26:0/3728922953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c015f2a0 0x7f45c006bd00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f45c0073360 tx=0x7f45b402a1e0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 -- 172.21.15.26:0/3728922953 shutdown_connections 2024-04-25T13:18:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 --2- 172.21.15.26:0/3728922953 >> v2:172.21.15.169:3300/0 conn(0x7f45c00c9270 0x7f45c006c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 --2- 172.21.15.26:0/3728922953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c015f2a0 0x7f45c006bd00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 -- 172.21.15.26:0/3728922953 >> 172.21.15.26:0/3728922953 conn(0x7f45c00cb150 msgr2=0x7f45c00cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 -- 172.21.15.26:0/3728922953 shutdown_connections 2024-04-25T13:18:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.059+0000 7f45c515d640 1 -- 172.21.15.26:0/3728922953 wait complete. 2024-04-25T13:18:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.061+0000 7f45c515d640 1 Processor -- start 2024-04-25T13:18:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.061+0000 7f45c515d640 1 -- start start 2024-04-25T13:18:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.061+0000 7f45c515d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45c006b920 0x7f45c00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45c515d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c00c9270 0x7f45c01f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45c515d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45c015f2a0 0x7f45c0140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45c515d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45c015bf50 con 0x7f45c00c9270 2024-04-25T13:18:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45c515d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45c015bc70 con 0x7f45c006b920 2024-04-25T13:18:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45c515d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f45c0144740 con 0x7f45c015f2a0 2024-04-25T13:18:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c00c9270 0x7f45c01f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c00c9270 0x7f45c01f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45184/0 (socket says 172.21.15.26:45184) 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 -- 172.21.15.26:0/686332461 learned_addr learned my addr 172.21.15.26:0/686332461 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45bf59e640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45c015f2a0 0x7f45c0140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45bed9d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45c006b920 0x7f45c00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 -- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45c015f2a0 msgr2=0x7f45c0140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45c015f2a0 0x7f45c0140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 -- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45c006b920 msgr2=0x7f45c00c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45c006b920 0x7f45c00c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 -- 172.21.15.26:0/686332461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c01f16e0 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45be59c640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c00c9270 0x7f45c01f56e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f45b402a220 tx=0x7f45b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45a77fe640 1 -- 172.21.15.26:0/686332461 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4037040 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45a77fe640 1 -- 172.21.15.26:0/686332461 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45b4042070 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c00c5f50 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45a77fe640 1 -- 172.21.15.26:0/686332461 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4030920 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.062+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c015e440 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.064+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c004fd80 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.064+0000 7f45a77fe640 1 -- 172.21.15.26:0/686332461 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45b4030ac0 con 0x7f45c00c9270 2024-04-25T13:18:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.064+0000 7f45a77fe640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f45ac06c8f0 0x7f45ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.064+0000 7f45a77fe640 1 -- 172.21.15.26:0/686332461 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6197+0+0 (secure 0 0 0) 0x7f45b40ac6c0 con 0x7f45c00c9270 2024-04-25T13:18:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.064+0000 7f45bed9d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f45ac06c8f0 0x7f45ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.065+0000 7f45bed9d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f45ac06c8f0 0x7f45ac06edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f45b0000f60 tx=0x7f45b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.069+0000 7f45a77fe640 1 -- 172.21.15.26:0/686332461 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45c004fd80 con 0x7f45c00c9270 2024-04-25T13:18:15.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.253+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45c00c9050 con 0x7f45c00c9270 2024-04-25T13:18:15.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.938+0000 7f45a77fe640 1 -- 172.21.15.26:0/686332461 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f45b40aae20 con 0x7f45c00c9270 2024-04-25T13:18:15.938 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data_ec' removed 2024-04-25T13:18:15.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f45ac06c8f0 msgr2=0x7f45ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:15.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f45ac06c8f0 0x7f45ac06edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f45b0000f60 tx=0x7f45b0009040 comp rx=0 tx=0).stop 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c00c9270 msgr2=0x7f45c01f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c00c9270 0x7f45c01f56e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f45b402a220 tx=0x7f45b40046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 shutdown_connections 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:6832/1178802827,v1:172.21.15.169:6833/1178802827] conn(0x7f45ac06c8f0 0x7f45ac06edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45c015f2a0 0x7f45c0140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c00c9270 0x7f45c01f56e0 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f45b402a220 tx=0x7f45b40046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 --2- 172.21.15.26:0/686332461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45c006b920 0x7f45c00c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:15.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.941+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 >> 172.21.15.26:0/686332461 conn(0x7f45c00cb150 msgr2=0x7f45c006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:15.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.942+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 shutdown_connections 2024-04-25T13:18:15.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-25T13:18:15.942+0000 7f45c515d640 1 -- 172.21.15.26:0/686332461 wait complete. 2024-04-25T13:18:15.956 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T13:18:15.957 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T13:18:15.957 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:15.967 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T13:18:15.967 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T13:18:15.967 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.018 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T13:18:16.019 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T13:18:16.019 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.070 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T13:18:16.071 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T13:18:16.071 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.082 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T13:18:16.083 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T13:18:16.083 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.135 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T13:18:16.135 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T13:18:16.135 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.189 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T13:18:16.190 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T13:18:16.190 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T13:18:16.190 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.218 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T13:18:16.218 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T13:18:16.218 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.297 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T13:18:16.298 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T13:18:16.298 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.371 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T13:18:16.371 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T13:18:16.371 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.442 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T13:18:16.443 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T13:18:16.443 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.470 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T13:18:16.470 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T13:18:16.470 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.548 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T13:18:16.548 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T13:18:16.548 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.625 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T13:18:16.625 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T13:18:16.625 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.708 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T13:18:16.709 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T13:18:16.709 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T13:18:16.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.737 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T13:18:16.737 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T13:18:16.738 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.767 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T13:18:16.767 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T13:18:16.767 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T13:18:16.767 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.791 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T13:18:16.791 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T13:18:16.792 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.819 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T13:18:16.819 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T13:18:16.819 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:16.872 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T13:18:16.873 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T13:18:16.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-25T13:18:16.921 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:18:16.922 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T13:18:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:18:17.221 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T13:18:17.291 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:18:17.292 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T13:18:17.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:18:17.349 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T13:18:17.406 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:18:17.407 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T13:18:17.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:18:17.592 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T13:18:17.654 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:18:17.655 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T13:18:17.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:18:17.697 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T13:18:17.779 INFO:tasks.ceph:Archiving mon data... 2024-04-25T13:18:17.780 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/data/mon.a.tgz 2024-04-25T13:18:17.781 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-04-25T13:18:17.799 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.nqoL0fCnlq 2024-04-25T13:18:17.800 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nqoL0fCnlq 2024-04-25T13:18:17.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.nqoL0fCnlq 2024-04-25T13:18:18.018 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.nqoL0fCnlq is 293KB 2024-04-25T13:18:18.085 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.nqoL0fCnlq 2024-04-25T13:18:18.101 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/data/mon.b.tgz 2024-04-25T13:18:18.101 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-25T13:18:18.117 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.KC0w4NAfNk 2024-04-25T13:18:18.118 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.KC0w4NAfNk 2024-04-25T13:18:18.266 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.KC0w4NAfNk 2024-04-25T13:18:18.346 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.KC0w4NAfNk is 395KB 2024-04-25T13:18:18.413 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.KC0w4NAfNk 2024-04-25T13:18:18.427 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/data/mon.c.tgz 2024-04-25T13:18:18.427 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-25T13:18:18.481 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.6m2ZDrRoob 2024-04-25T13:18:18.481 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6m2ZDrRoob 2024-04-25T13:18:18.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.6m2ZDrRoob 2024-04-25T13:18:18.698 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.6m2ZDrRoob is 395KB 2024-04-25T13:18:18.764 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.6m2ZDrRoob 2024-04-25T13:18:18.778 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T13:18:18.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:18:18.781 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:18:18.867 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:18:18.895 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:18:18.895 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T13:18:18.897 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/remote/smithi026/crash 2024-04-25T13:18:18.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:18:18.935 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/remote/smithi169/crash 2024-04-25T13:18:18.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:18:18.960 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T13:18:18.960 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:18.980 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:19.053 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:19.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:19.104 INFO:tasks.ceph:Compressing logs... 2024-04-25T13:18:19.104 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:18:19.123 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:18:19.147 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40046.log 2024-04-25T13:18:19.148 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42954.log 2024-04-25T13:18:19.148 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43295.log 2024-04-25T13:18:19.185 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:18:19.186 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34889.log 2024-04-25T13:18:19.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34849.log 2024-04-25T13:18:19.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34598.log 2024-04-25T13:18:19.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34849.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T13:18:19.186 INFO:teuthology.orchestra.run.smithi169.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34889.log.gz 2024-04-25T13:18:19.187 INFO:teuthology.orchestra.run.smithi169.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34849.log.gz 2024-04-25T13:18:19.187 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:18:19.187 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34598.log: /var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T13:18:19.187 INFO:teuthology.orchestra.run.smithi169.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34598.log.gz 2024-04-25T13:18:19.187 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34678.log 2024-04-25T13:18:19.187 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:18:19.188 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T13:18:19.188 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T13:18:19.188 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34678.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T13:18:19.188 INFO:teuthology.orchestra.run.smithi169.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34678.log.gz 2024-04-25T13:18:19.188 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T13:18:19.188 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:18:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T13:18:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose --/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.34638.log 2024-04-25T13:18:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T13:18:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34638.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34638.log.gz 2024-04-25T13:18:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34769.log 2024-04-25T13:18:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.6.log: 91.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T13:18:19.194 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34729.log 2024-04-25T13:18:19.194 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34769.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34769.log.gz 2024-04-25T13:18:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34809.log 2024-04-25T13:18:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34729.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34729.log.gz 2024-04-25T13:18:19.207 INFO:teuthology.orchestra.run.smithi169.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T13:18:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T13:18:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34809.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T13:18:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.d.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34809.log.gz 2024-04-25T13:18:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.b.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T13:18:19.217 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47162.log 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40046.log.gz 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42954.log: /var/log/ceph/ceph-client.admin.43295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41445.log 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42954.log.gz 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43295.log.gz 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47078.log 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34411.log 2024-04-25T13:18:19.252 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47162.log.gz 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47078.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.41445.log.gz 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.42617.log 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47078.log.gz 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-client.admin.34411.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40260.log 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46402.log 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40260.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.34411.log.gz 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2024-04-25T13:18:19.253 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40260.log.gz 2024-04-25T13:18:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43161.log 2024-04-25T13:18:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-04-25T13:18:19.254 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46402.log.gz 2024-04-25T13:18:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43161.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2024-04-25T13:18:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2024-04-25T13:18:19.254 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43161.log.gz 2024-04-25T13:18:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42061.log 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42187.log 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42061.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42061.log.gz 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39816.log 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42187.log.gz 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43299.log 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46234.log 2024-04-25T13:18:19.255 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39816.log.gz 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45884.log 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43299.log.gz 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46234.log: gzip -5 --verbose -- 85.0% /var/log/ceph/ceph-client.admin.44308.log 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42313.log 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46234.log.gz 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45884.log.gz 2024-04-25T13:18:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46276.log 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41361.log 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42313.log: /var/log/ceph/ceph-client.admin.46276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42313.log.gz 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46276.log.gz 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41361.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41361.log.gz 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2024-04-25T13:18:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43301.log 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44224.log 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43301.log.gz 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43762.log: /var/log/ceph/ceph-client.admin.44224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2024-04-25T13:18:19.258 INFO:teuthology.orchestra.run.smithi026.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44224.log.gz 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45574.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2024-04-25T13:18:19.259 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44395.log: /var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47246.log 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47246.log.gz 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44801.log 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44098.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-04-25T13:18:19.260 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46192.log 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46192.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40430.log 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46192.log.gz 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42950.log 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40430.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-04-25T13:18:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2024-04-25T13:18:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41487.log 89.3% 2024-04-25T13:18:19.262 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40430.log.gz 2024-04-25T13:18:19.262 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42950.log.gz 2024-04-25T13:18:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46570.log 2024-04-25T13:18:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46966.log: /var/log/ceph/ceph-client.admin.41487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40682.log 2024-04-25T13:18:19.262 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2024-04-25T13:18:19.262 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46570.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46570.log.gz 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45758.log 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43300.log: gzip -5 --verbose -- 91.1% /var/log/ceph/ceph-client.admin.42957.log -- replaced with /var/log/ceph/ceph-client.admin.40682.log.gz 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-04-25T13:18:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42229.log 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42957.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45758.log.gz 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45447.log 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-client.admin.42229.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40132.log 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42957.log.gz 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42229.log.gz 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45447.log.gz 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42613.log 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40132.log: /var/log/ceph/ceph-client.admin.44266.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T13:18:19.264 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40132.log.gz 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42613.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40556.log 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42613.log.gz 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.40556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46360.log 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42616.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40556.log.gz 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T13:18:19.265 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46360.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.1.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46360.log.gz 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44353.log 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42952.log 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-04-25T13:18:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40640.log 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34790.log 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44353.log.gz 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42952.log: /var/log/ceph/ceph-client.admin.40640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40514.log 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8%/var/log/ceph/ceph-client.admin.34790.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40640.log.gz 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42952.log.gz 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40514.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34790.log.gz 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40304.log 2024-04-25T13:18:19.267 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40514.log.gz 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40598.log 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40088.log 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40598.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40304.log.gz 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41629.log 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40598.log.gz 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44479.log 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40088.log.gz 2024-04-25T13:18:19.268 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43888.log 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41629.log.gz 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45842.log 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43888.log: gzip -5 --verbose -- 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44479.log.gz 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.46528.log 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1%/var/log/ceph/ceph-client.admin.45842.log: -- replaced with /var/log/ceph/ceph-client.admin.43888.log.gz 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46150.log 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45842.log.gz 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42103.log 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46528.log.gz 2024-04-25T13:18:19.269 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40218.log 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42103.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46150.log.gz 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42439.log 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42103.log.gz 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43297.log 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40218.log.gz 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43297.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39858.log 2024-04-25T13:18:19.270 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42439.log.gz 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43297.log.gz 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39962.log 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39858.log: --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42944.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39858.log.gz 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4%/var/log/ceph/ceph-mon.a.log: -- replaced with /var/log/ceph/ceph-client.admin.39962.log.gz 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44545.log 2024-04-25T13:18:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40004.log 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3%/var/log/ceph/ceph-client.admin.44545.log: -- replaced with /var/log/ceph/ceph-client.admin.42944.log.gz 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46108.log 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40004.log: -- /var/log/ceph/ceph-client.admin.40388.log 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44545.log.gz 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40004.log.gz 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46108.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46108.log.gz 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46864.log 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39522.log 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46864.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40388.log.gzgzip 2024-04-25T13:18:19.272 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46864.log.gz 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39522.log: /var/log/ceph/ceph-client.admin.44611.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39522.log.gz 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43674.log 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40176.log 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39716.log: /var/log/ceph/ceph-client.admin.43674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-04-25T13:18:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40176.log: 87.7% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43674.log.gz 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr:gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40176.log.gz -- 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.41671.log 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-client.admin.47368.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41529.log 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41935.log 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41529.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41529.log.gz 2024-04-25T13:18:19.274 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41935.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8%/var/log/ceph/ceph-client.admin.43804.log: -- replaced with /var/log/ceph/ceph-client.admin.41935.log.gz 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47120.log 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.47120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39601.log 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42618.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47120.log.gz 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45532.log 2024-04-25T13:18:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45532.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39601.log.gz 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45532.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44182.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43539.log 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41403.log 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43539.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43539.log.gz 2024-04-25T13:18:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43846.log 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41403.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41403.log.gz 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42620.log 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43497.log 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42620.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43846.log.gz 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42620.log.gz 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42619.log 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42397.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43497.log.gz 2024-04-25T13:18:19.277 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41839.log 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46486.log 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41839.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42619.log.gz 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41839.log.gz 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28383.log 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46444.log 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.tmp-client.admin.28383.log: 87.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46486.log.gz 2024-04-25T13:18:19.278 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.28383.log.gz 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46318.log 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45196.log 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46318.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46444.log.gz 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46318.log.gz 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.45196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42612.log 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42621.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.0.45196.log.gz 2024-04-25T13:18:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40346.log 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45716.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42612.log.gz 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41713.log 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39902.log 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41713.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40346.log.gz 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41713.log.gz 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45490.log 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47038.log 2024-04-25T13:18:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45490.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39902.log.gz 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45490.log.gz 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47204.log 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47204.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47038.log.gz 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47204.log.gz 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40472.log 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44056.log 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.40472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40472.log.gz 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2024-04-25T13:18:19.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44677.log 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43972.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44056.log.gz 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.44677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42956.log 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44677.log.gz 2024-04-25T13:18:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.45800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42019.log 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42956.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42956.log.gz 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42019.log: /var/log/ceph/ceph-client.admin.45658.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42019.log.gz 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40748.log 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42355.log 2024-04-25T13:18:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47410.log: /var/log/ceph/ceph-client.admin.40748.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40748.log.gz 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.42355.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42355.log.gz 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42145.log 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46066.log 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46906.log: /var/log/ceph/ceph-client.admin.42145.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42145.log.gz 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46066.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46066.log.gz 2024-04-25T13:18:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42271.log 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41571.log 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.47452.log: /var/log/ceph/ceph-client.admin.42271.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46612.log 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42271.log.gz 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41571.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41571.log.gz 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46612.log: /var/log/ceph/ceph-client.admin.47324.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46612.log.gz 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2024-04-25T13:18:19.285 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41755.log 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.43624.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41797.log 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41755.log: /var/log/ceph/ceph-client.admin.43298.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41755.log.gz 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46822.log 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.41797.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41797.log.gz 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.46822.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46822.log.gz 2024-04-25T13:18:19.286 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T13:18:19.287 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T13:18:19.288 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T13:18:19.417 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T13:18:19.779 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T13:18:19.806 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T13:18:19.811 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T13:18:19.831 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T13:18:19.846 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T13:18:19.861 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T13:18:19.868 INFO:teuthology.orchestra.run.smithi169.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T13:18:19.870 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-25T13:18:19.870 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m0.712s 2024-04-25T13:18:19.870 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m2.839s 2024-04-25T13:18:19.870 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.112s 2024-04-25T13:18:19.908 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T13:18:19.910 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-25T13:18:19.910 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m0.773s 2024-04-25T13:18:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m2.990s 2024-04-25T13:18:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m0.216s 2024-04-25T13:18:19.911 INFO:tasks.ceph:Archiving logs... 2024-04-25T13:18:19.911 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/remote/smithi026/log 2024-04-25T13:18:19.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:18:20.528 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/remote/smithi169/log 2024-04-25T13:18:20.529 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:18:20.970 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T13:18:20.980 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T13:18:20.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:18:20.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:18:21.057 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T13:18:21.066 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T13:18:21.066 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:18:21.069 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:18:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:18:21.084 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:18:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:18:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-04-25T13:18:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +923us[ +920us] +/- 49ms 2024-04-25T13:18:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -1519us[-1522us] +/- 56ms 2024-04-25T13:18:21.088 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +522us[ +519us] +/- 65ms 2024-04-25T13:18:21.088 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:18:21.089 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:18:21.089 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-04-25T13:18:21.089 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +923us[ +921us] +/- 49ms 2024-04-25T13:18:21.089 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -1520us[-1522us] +/- 56ms 2024-04-25T13:18:21.090 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +527us[ +527us] +/- 65ms 2024-04-25T13:18:21.090 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:18:21.090 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T13:18:21.099 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T13:18:21.100 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T13:18:21.131 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:18:21.200 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:18:21.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:18:21.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:21.291 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:18:21.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:21.317 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T13:18:21.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T13:18:21.365 INFO:teuthology.task.internal:Duration was 528.166166 seconds 2024-04-25T13:18:21.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T13:18:21.398 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T13:18:21.399 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:18:21.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:18:21.438 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:18:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:18:21.692 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T13:18:21.692 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-04-25T13:18:21.693 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:18:21.740 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-04-25T13:18:21.740 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:18:21.767 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T13:18:21.767 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:18:21.782 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:18:21.831 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T13:18:21.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:18:21.850 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:18:21.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T13:18:21.977 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T13:18:21.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:18:22.002 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:18:22.026 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T13:18:22.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:22.045 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:22.066 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-04-25T13:18:22.088 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-04-25T13:18:22.117 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:22.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:22.133 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:22.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:22.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T13:18:22.194 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T13:18:22.195 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/remote/smithi026 2024-04-25T13:18:22.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:18:22.234 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469/remote/smithi169 2024-04-25T13:18:22.235 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:18:22.266 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T13:18:22.267 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:18:22.270 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:18:22.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T13:18:22.337 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T13:18:22.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T13:18:22.399 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T13:18:22.399 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:18:22.402 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:18:22.414 INFO:teuthology.orchestra.run.smithi026.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:18 /home/ubuntu/cephtest 2024-04-25T13:18:22.416 INFO:teuthology.orchestra.run.smithi169.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:18 /home/ubuntu/cephtest 2024-04-25T13:18:22.418 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T13:18:22.429 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T13:18:22.476 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T13:18:22.501 DEBUG:teuthology.nuke:shortname: smithi026 2024-04-25T13:18:22.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:18:22.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:04:00.058368', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYqkuomIzCabtpBW7YNjtop9vFL4fsVddjZoSpfNkL3ZwHtIKEhiU624UCRzFt4Qw0yRCP6L82NJ1BhapAf7QA='} 2024-04-25T13:18:22.527 DEBUG:teuthology.nuke:shortname: smithi169 2024-04-25T13:18:22.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:18:22.547 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:04:00.059682', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJVEriTr7y8K+7Cf0JKJYou4B9IC+pb4i54Q4XH1LvaZ4qD66VgIoB8NuqbM/TdIrpZ0M1XDsPsD7OclhwZ+1E='} 2024-04-25T13:18:22.576 INFO:teuthology.orchestra.console.smithi026:Power off 2024-04-25T13:18:22.576 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T13:18:22.600 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-04-25T13:18:22.600 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:22.618 INFO:teuthology.orchestra.console.smithi169:Power off 2024-04-25T13:18:22.618 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T13:18:22.628 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-25T13:18:22.641 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-04-25T13:18:22.641 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:22.664 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-25T13:18:26.630 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:26.665 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:26.740 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-25T13:18:26.774 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-25T13:18:30.742 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:30.774 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:30.853 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-04-25T13:18:30.883 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-04-25T13:18:30.954 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-04-25T13:18:30.984 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-04-25T13:18:31.089 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} duration: 528.166166305542 failure_reason: '''NoneType'' object has no attribute ''get''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=db59ab1d22c340e99d483475734e602c status: fail success: false 2024-04-25T13:18:31.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:18:31.170 INFO:teuthology.run:FAIL